ADF - Skip multiple activities

Kothai Ramanathan 941 Reputation points Microsoft Employee
2020-08-18T09:54:39.227+00:00

Is there a way to skip a set of activities in a pipeline ? In my pipeline, I execute a meta data activity to get the list of files from a fileshare, and need to execute the subsequent activities only if there are any files returned. How can I do this ? I thought I can put all the subsequent activities in a if condition, but the subsequent activities contain foreach, and not able to move the foreach within the if (as this is not supported).

Also dont want to move all the subsequent activities into a child pipeline, then the original pipeline is almost empty. The original pipeline is to execute a set of activities for the list of files that I read in the meta data activity.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,656 questions
{count} votes

Accepted answer
  1. Vaibhav Chaudhari 38,726 Reputation points
    2020-08-18T11:52:07.883+00:00

    As a workaround, could you try to use Validate activity to check if file exists. Based on success, it should process files further else on failure some notification activity etc. as shown in diagram in this thread - just-want-to-validate-if-a-file-exists-in-my-data.html

    =========================================================

    Please don't forget to "Accept Answer" and upvote if the response helped -- Vaibhav

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.