Why ForEach activity declaring success in Data Factory taking too long?

Question

We have a ForEach activity running in an Azure Data Factory pipeline to copy data from source to destination. But ForEach activity taking long time to success where as all other inner activity is completed. We are experience this issue from past few days. We need to stop pipeline and rerun every time due to this issue.

Answer 1

Hi @Dharmendra Barad

I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Issue: We have a ForEach activity running in an Azure Data Factory pipeline to copy data from source to destination. But ForEach activity taking long time to success where as all other inner activity is completed. We are experience this issue from past few days. We need to stop pipeline and rerun every time due to this issue.

Solution: Actually, I have enabled Elapsed time metric in pipeline setting for long running pipeline alert. Once I have disabled this setting my pipeline is working fine and ForEach loop are not taking much time. Don't know the exact reason behind this. But currently pipeline is working as expected.

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

I hope this helps!

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Actually, I have enabled Elapsed time metric in pipeline setting for long running pipeline alert. Once I have disabled this setting my pipeline is working fine and ForEach loop are not taking much time. Don't know the exact reason behind this. But currently pipeline is working as expected.