Is there any way to monitor internal azure data factory pipeline like Payload size, number of retries etc?

Question

Is there any way to monitor internal azure data factory pipeline like Payload size, number of retries etc?

Kavya Verma 21

I want to monitor the Azure data factory pipeline parameters like number of pipeline retries, payload size, Concurrent jobs running, and similar compute infrastructure and other performance parameters. Is there any way to monitor these? I have already checked the service-specific metrics parameters available in diagnostic settings.

ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator

2021-11-29T14:16:00.213+00:00

Hi @Kavya Verma ,

Just checking to see if above answer you? If yes, please consider hitting Accept Answer. Accepted answers helps community as well. Please let us know if any further queries. Thank you.

1 answer

Your answer

ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator

2021-11-29T14:16:00.213+00:00

Hi @Kavya Verma ,

Just checking to see if above answer you? If yes, please consider hitting Accept Answer. Accepted answers helps community as well. Please let us know if any further queries. Thank you.

Answer 1

Samy Abdul 3,376

Hi @Kavya Verma ,This might help:

https://learn.microsoft.com/en-us/answers/questions/630918/centralized-adf-logs-for-all-customers.html Thanks

ShaikMaheer-MSFT 38,551 Reputation points Microsoft Employee Moderator

2021-11-26T09:15:55.843+00:00

Hi @Kavya Verma ,

Following up to see if above answer helps you? If yes, please consider hitting Accept Answer. Accepted answers helps community as well. Please let us know if any further queries. Thank you.

Share via

Is there any way to monitor internal azure data factory pipeline like Payload size, number of retries etc?

1 answer

Your answer