Handling error across all activities in a pipeline

Kothai Ramanathan (SC-ALT) 51 Reputation points Microsoft Employee
2021-02-19T05:25:32.577+00:00

I want some error processing to be done if any of the activities in a pipeline fail. I see that for every activity there is a failure workflow, but how to mention that for any failure in any of the activities, do something.

In logic apps, there is a scope which can combine activities and have error handling as a group. Is there an equivalent in ADF ? If not, what is the best way to handle such scenarios ?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,643 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Nandan Hegde 29,896 Reputation points MVP
    2021-02-19T05:53:45.007+00:00

    Hey @Kothai Ramanathan (SC-ALT) ,
    There are 2 ways :

    1. You have 2 pipelines within the ADF
      Pipeline1 is the main pipeline which contains all the logics
      Pipeline 2 is execute pipeline activity calling pipeline1 and after that any required activity you need to work on in case of failure.

    2) For each activity, failure workflow link a activity but this would create trouble in feature as there is a restriction of only 40 activities per pipeline in ADF as of today

    0 comments No comments