Log Copy Details to Log Analytics

Harry Leboeuf 0 Reputation points
2023-05-19T08:59:45.0433333+00:00

Hello,

Its quite easy to have quite some logging data avout your ADF activities in Log-Analytics or files on a ADLS.

In a copy actvity you can also enable logging to a ADLS that writes in details all 'counters' from the Copy Activity like Rows read, ...

But this goes into a separate way, yoy have to specify activity by activity.

Is there a way to get these figures in the 'normal' logging set by the Diagnostrics settings ?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
7,182 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. HimanshuSinha-msft 19,201 Reputation points Microsoft Employee
    2023-05-19T14:57:52.8433333+00:00

    Hello @Harry Leboeuf ,

    Thanks for the question and using MS Q&A platform.

    One quick option to use the ADF API and it does give all the data you are looking for.
    Activity Runs - Query By Pipeline Run

    Sample output :
    User's image

    Thanks

    Himanshu

    Please accept as "Yes" if the answer provided is useful , so that you can help others in the community looking for remediation for similar issues. 

    0 comments