monitor azure data factory using azure monitor

Michael Stoler 225 Reputation points


Is there a document on how to monitor Azure Data Factory using Azure Monitor?

As an example if I have several Azure Data Factories and I want to see them all together in Azure Monitor and if I want logs for more then 45 days.

Thank You,


Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,526 questions
0 comments No comments
{count} votes

Accepted answer
  1. Harishga 945 Reputation points Microsoft Vendor

    Hi@Michael Stoler

    Adding to Konstantinos Passadis

    To see several Azure Data Factories together in Azure Monitor and keep logs for more than 45 days, follow these steps:

    • Enable diagnostic logs for your Azure Data Factories using Azure Monitor.
    • Choose a target for your diagnostic logs. You can save them to a storage account for auditing or manual inspection, stream them to Azure Event Hubs for ingestion by a third-party service or custom analytics solution, or analyze them with Azure Log Analytics.
    • Specify the retention time for your diagnostic logs. By default, Azure Data Factory stores pipeline-run data for only 45 days.
    • If you choose to analyze your diagnostic logs with Azure Log Analytics, you can create custom queries and alerts on the rich set of metrics published by your data factories to Azure Monitor.

    Reference links:

    I hope this information helps you. Let me know if you have any further questions or concerns.
    Hope this helps. Do let us know if you any further queries.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Konstantinos Passadis 13,771 Reputation points

    Hello @Michael Stoler !

    Please have a look here

    I think it is what you need !

    I hope this helps!

    Kindly mark the answer as Accepted and Upvote in case it helped!


    0 comments No comments