Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,696 questions
Azure Data Factory - Copy Activities remain queued
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 25%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ES%3C/text%3E%3C/svg%3E)
Simon
1
Reputation point
I have an Azure Data Factory pipeline with 4 copy tasks. Whenever the pipeline is triggered they remain queued indefinitely. They are trying to copy from a self-hosted integration runtime (v5.4.7732.1) to a Microsoft shared runtime. This is happening on a production pipeline.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT 46,487 Reputation points Microsoft Employee2021-07-26T20:15:31.053+00:00 Hi @Simon ,
Welcome to Microsoft Q&A forum and thanks for reaching out.
Could you please confirm if this pipeline was working fine before and this issue has started all of sudden? And also, please give a try upgrading SHIR version to latest (Download link) and see if that helps to resolve the issue.
There could be other reason like Concurrency Limit, Monitoring limits or Transient Issues. For detailed info please refer to this troubleshooting guide: Pipeline status is queued or stuck for a long time
If this info didn't help, I would recommend you to file a support ticket for deeper investigation. In case if you don't have a support plan, please do let us know here.
We look forward to your confirmation.
-
KranthiPakala-MSFT 46,487 Reputation points Microsoft Employee
2021-07-27T19:00:58.34+00:00 Hi @Simon ,
Just checking in to see if the above suggestion was helpful to resolve your issue. And, if you have any further query do let us know. If you have filed a support ticket would you please share it here with us so that we can track it internally.
Thank you
-
Simon 1 Reputation point
2021-07-28T19:20:58.637+00:00 Hi @KranthiPakala-MSFT , I have updated to the latest SHIR today but I am still experiencing the same issue. I have turned off trigers and recursively cancelled all occurrences of the pipeline. When I manually debug the pipeline I still get the issue where all Copy tasks remain queued and never go into "in progress".
Sign in to comment
Sign in to answer