ForEach activity restartability of failed activities in the loop

Kiran 26 Reputation points
2023-08-31T07:53:55.9366667+00:00

Hello, How to rerun a failed activity within a ForEach loop activity? For Example: Say I have 10 activities, 9 of them ran successful but 1 failed. How to run just that one activity when I restart the pipeline? When I rerun the pipeline now all of the 10 activities run.

The below image suggests to try "Retry" but it wouldn't work if I need to fix something before I can rerun the pipeline.

image

Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,309 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,444 questions
0 comments No comments
{count} votes

Accepted answer
  1. Nandan Hegde 35,021 Reputation points MVP
    2023-08-31T08:06:54.0533333+00:00

    Hey ,

    Unfortunately based on my understanding, in case some activity has failed within for activity and you rerun from failed activity, it would again iterate for the entire number of iterations and not just the failed one.

    Now, in case if you want to run just the failed iteration, then you would have to keep a log table and have a flag updated at the end of every iteration for a successful one.

    AND then run the entire pipeline again as it would now take the iteration of just failed one (the one where flag was not updated)

    You can raise a feedback for #1 with MSFT


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.