monitor azure data factory using azure monitor

Question

Hello,

Is there a document on how to monitor Azure Data Factory using Azure Monitor?

As an example if I have several Azure Data Factories and I want to see them all together in Azure Monitor and if I want logs for more then 45 days.

Thank You,

Michael

Answer 1

Hi@Michael Stoler

Adding to Konstantinos Passadis

To see several Azure Data Factories together in Azure Monitor and keep logs for more than 45 days, follow these steps:

• Enable diagnostic logs for your Azure Data Factories using Azure Monitor.
• Choose a target for your diagnostic logs. You can save them to a storage account for auditing or manual inspection, stream them to Azure Event Hubs for ingestion by a third-party service or custom analytics solution, or analyze them with Azure Log Analytics.
• Specify the retention time for your diagnostic logs. By default, Azure Data Factory stores pipeline-run data for only 45 days.
• If you choose to analyze your diagnostic logs with Azure Log Analytics, you can create custom queries and alerts on the rich set of metrics published by your data factories to Azure Monitor.

Reference links:

https://youtu.be/B79cjl0BAfY

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/create-diagnostic-settings?tabs=portal

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/tutorial-resource-logs

I hope this information helps you. Let me know if you have any further questions or concerns.
Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 2

Hello @Michael Stoler !

Please have a look here

I think it is what you need !

https://learn.microsoft.com/en-us/azure/data-factory/monitor-using-azure-monitor

---

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!

Regards