Why ForEach activity declaring success in Data Factory taking too long?

Dharmendra Barad 20 Reputation points
2024-06-15T08:28:26.0933333+00:00

We have a ForEach activity running in an Azure Data Factory pipeline to copy data from source to destination. But ForEach activity taking long time to success where as all other inner activity is completed. We are experience this issue from past few days. We need to stop pipeline and rerun every time due to this issue.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,133 questions
{count} votes

Accepted answer
  1. Smaran Thoomu 12,615 Reputation points Microsoft Vendor
    2024-06-18T06:09:06.3133333+00:00

    Hi @Dharmendra Barad

    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

    Issue: We have a ForEach activity running in an Azure Data Factory pipeline to copy data from source to destination. But ForEach activity taking long time to success where as all other inner activity is completed. We are experience this issue from past few days. We need to stop pipeline and rerun every time due to this issue.

    Solution: Actually, I have enabled Elapsed time metric in pipeline setting for long running pipeline alert. Once I have disabled this setting my pipeline is working fine and ForEach loop are not taking much time. Don't know the exact reason behind this. But currently pipeline is working as expected.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

    I hope this helps!

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    0 comments No comments

3 additional answers

Sort by: Most helpful
  1. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

    1 deleted comment

    Comments have been turned off. Learn more

  2. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.


    Comments have been turned off. Learn more

  3. Dharmendra Barad 20 Reputation points
    2024-06-18T05:45:33.86+00:00

    Actually, I have enabled Elapsed time metric in pipeline setting for long running pipeline alert. Once I have disabled this setting my pipeline is working fine and ForEach loop are not taking much time. Don't know the exact reason behind this. But currently pipeline is working as expected.