Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
6,709 questions
Azure Data Factory Copy Activity is stuck in "Queued" status.
Shubham Kumar Jain
1
Reputation point
Hi Team,
I have a pipeline in which one of the copy activity is stuck in "Queued" status. Normally it takes 20-30 seconds to finish but it is stuck since last 7-8 hours and still in the same state.
Location - uksouth
Pipeline activity run ID - '4618b2c0-0423-431b-8d5c-6c7153939cef'
Request you to resolve it ASAP.
Thanks in advance
{count} votes
-
Shubham Kumar Jain 1 Reputation point
2020-12-10T08:34:25.6+00:00 It's been more then 24 hours and the copy activity is still in queued state. Can you please help?
Pipeline failed after in queued state for almost 50 hours with an error as below.
Error details
Error code: 1000
Troubleshooting guide
Failure type: System error
Details: The copy activity run was terminated due to execution stuck on retrieving data. Please double check your data sources' availability and retry. If the issue persists, contact support for help.
Hi @Shubham Kumar Jain ,
Are you using a self-hosted IR?
No, it is Azure Integration run time.
Hi @Shubham Kumar Jain ,
Please see this guidance for troubleshooting Azure hosted IR:
https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-performance-troubleshooting?WT.mc_id=Portal-Microsoft_Azure_Support#troubleshoot-copy-activity-on-azure-ir
Let me know if this helps to resolve the issue.
Hello ,
We have not heard back from you on this and was just following up .
Incase if you have resolution , request you to share the same here , so that other community members can benefit from that .
Thanks
Himanshu
That copy activity failed after 50 hours.
Again I have faced the same issue in the same pipeline with another copy activity and it also failed after a long duration in queued state. When I rerun the pipeline from failed activity, It ran successfully. but I am not understanding why it is getting stuck in queued state randomly and then failing after a long time.
Hello @Shubham Kumar Jain ,
At ths time we need to look into the logs etc so I suggest if you have a support plan you may file a support ticket, else could you please send an email to AzCommunity@microsoft.com with the below details,
so that we can create a one-time-free support ticket for you to work closely on this matter.
Thread URL:
Subscription ID:
Subject:Attention :Himanshu / Martin
Please let me know once you have done the same
Thanks
Himanshu
Hi @HimanshuSinha-msft
I have mailed the details as requested. Today we have faced the same thing in our production environment where one copy activity is stuck in "queued" state from a very long time.
Request you to resolve it asap.
Thanks,
Shubham Kumar Jain
Hello @Shubham Kumar Jain ,
Thank you for reaching out.
We have enabled one-time free technical support.
I hope you have received one on one support to work towards a resolution on this matter.
Once the issue is sorted out with the support, please do share the resolution, which might be beneficial to other community members reading this thread.
Are there any know issues with this? I'm using self-hosted IR and the tasks get stuck in the queues for couple of minutes.
Sign in to comment
Activity