Azure Data Factory Copy Activity is stuck in "Queued" status.
Hi Team,
I have a pipeline in which one of the copy activity is stuck in "Queued" status. Normally it takes 20-30 seconds to finish but it is stuck since last 7-8 hours and still in the same state.
Location - uksouth
Pipeline activity run ID - '4618b2c0-0423-431b-8d5c-6c7153939cef'
Request you to resolve it ASAP.
Thanks in advance
Azure Data Factory
-
Shubham Kumar Jain • 1 Reputation point
2020-12-10T08:34:25.6+00:00 It's been more then 24 hours and the copy activity is still in queued state. Can you please help?
-
Shubham Kumar Jain • 1 Reputation point
2020-12-11T09:14:29.93+00:00 Pipeline failed after in queued state for almost 50 hours with an error as below.
Error details
Error code: 1000
Troubleshooting guide
Failure type: System error
Details: The copy activity run was terminated due to execution stuck on retrieving data. Please double check your data sources' availability and retry. If the issue persists, contact support for help. -
Lawrence080-MSFT • 46 Reputation points • Microsoft Employee
2020-12-11T19:44:24.8+00:00 Hi @Shubham Kumar Jain ,
Are you using a self-hosted IR?
-
Shubham Kumar Jain • 1 Reputation point
2020-12-14T08:03:29.527+00:00 No, it is Azure Integration run time.
-
Lawrence080-MSFT • 46 Reputation points • Microsoft Employee
2020-12-17T08:22:16.787+00:00 Hi @Shubham Kumar Jain ,
Please see this guidance for troubleshooting Azure hosted IR:
Let me know if this helps to resolve the issue.
-
HimanshuSinha-msft • 19,476 Reputation points • Microsoft Employee
2020-12-17T22:49:50.35+00:00 Hello ,
We have not heard back from you on this and was just following up .
Incase if you have resolution , request you to share the same here , so that other community members can benefit from that .
Thanks
Himanshu -
Shubham Kumar Jain • 1 Reputation point
2020-12-21T05:00:01.617+00:00 That copy activity failed after 50 hours.
Again I have faced the same issue in the same pipeline with another copy activity and it also failed after a long duration in queued state. When I rerun the pipeline from failed activity, It ran successfully. but I am not understanding why it is getting stuck in queued state randomly and then failing after a long time. -
HimanshuSinha-msft • 19,476 Reputation points • Microsoft Employee
2020-12-23T20:00:14.053+00:00 Hello @Shubham Kumar Jain ,
At ths time we need to look into the logs etc so I suggest if you have a support plan you may file a support ticket, else could you please send an email to AzCommunity@microsoft.com with the below details,
so that we can create a one-time-free support ticket for you to work closely on this matter.Thread URL:
Subscription ID:
Subject:Attention :Himanshu / Martin
Please let me know once you have done the same
Thanks
Himanshu -
Shubham Kumar Jain • 1 Reputation point
2020-12-27T14:13:52.273+00:00 I have mailed the details as requested. Today we have faced the same thing in our production environment where one copy activity is stuck in "queued" state from a very long time.
Request you to resolve it asap.
Thanks,
Shubham Kumar Jain -
PRADEEPCHEEKATLA • 90,541 Reputation points
2020-12-28T05:39:51.513+00:00 Hello @Shubham Kumar Jain ,
Thank you for reaching out.
We have enabled one-time free technical support.
I hope you have received one on one support to work towards a resolution on this matter.
Once the issue is sorted out with the support, please do share the resolution, which might be beneficial to other community members reading this thread.
-
Saru Thiagarajan • 31 Reputation points
2021-04-01T02:55:03.613+00:00 Are there any know issues with this? I'm using self-hosted IR and the tasks get stuck in the queues for couple of minutes.
Sign in to comment