Azure Pipeline Trigger Still Running after hours

Geoffrey SOUQUIÈRE 51 Reputation points
2022-10-05T10:15:54.687+00:00

Hi all,

Hope you are getting well.

I planned a Trigger to start pipeline automatically.

Sometimes, pipeline does not stop, keep running. See image bellow 247680-pipeline.png

Any information on it? I can not explain why is still running.

Have a nice day

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
{count} votes

Answer accepted by question author
  1. Pratik Somaiya 4,211 Reputation points Volunteer Moderator
    2022-10-05T12:47:11.517+00:00

    Thanks for providing the details of the issue @Geoffrey SOUQUIÈRE

    As I can understand the Copy Activity named Item is sometimes taking a much longer time to complete

    Have you seen the details of the copy activity during the run, it gives you details like how much time it took to connect to source, to get data from source and time to write to sink

    There can be other factors as well like:

    1) The source / sink data stores is connected via Self Hosted Integration Runtime (SHIR) and there is some bandwidth issue there
    2) If SHIR is used then you can check if some other pipelines run in parallel to this pipeline, in this case, the IR network is distributed for those pipelines as well, which is causing this activity to take longer time than expected
    3) Some queries are getting executed at source data store and the data fetch is provided less resources at source end to copy

    Can you check these details and let me know, so we can further drill down this error?

    Thanks

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.