Azure Data Factory - Copy Activities remain queued

Question

Azure Data Factory - Copy Activities remain queued

Simon 1

I have an Azure Data Factory pipeline with 4 copy tasks. Whenever the pipeline is triggered they remain queued indefinitely. They are trying to copy from a self-hosted integration runtime (v5.4.7732.1) to a Microsoft shared runtime. This is happening on a production pipeline.

KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2021-07-26T20:15:31.053+00:00

Hi @Simon ,

Welcome to Microsoft Q&A forum and thanks for reaching out.

Could you please confirm if this pipeline was working fine before and this issue has started all of sudden? And also, please give a try upgrading SHIR version to latest (Download link) and see if that helps to resolve the issue.

There could be other reason like Concurrency Limit, Monitoring limits or Transient Issues. For detailed info please refer to this troubleshooting guide: Pipeline status is queued or stuck for a long time

If this info didn't help, I would recommend you to file a support ticket for deeper investigation. In case if you don't have a support plan, please do let us know here.

We look forward to your confirmation.
KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2021-07-27T19:00:58.34+00:00

Hi @Simon ,

Just checking in to see if the above suggestion was helpful to resolve your issue. And, if you have any further query do let us know. If you have filed a support ticket would you please share it here with us so that we can track it internally.

Thank you
Simon 1 Reputation point

2021-07-28T19:20:58.637+00:00

Hi @KranthiPakala-MSFT , I have updated to the latest SHIR today but I am still experiencing the same issue. I have turned off trigers and recursively cancelled all occurrences of the pipeline. When I manually debug the pipeline I still get the issue where all Copy tasks remain queued and never go into "in progress".