ADF Trigger Usecase

Sarvagna Naidu 21 Reputation points
2021-09-01T07:06:39.103+00:00

We have requirement where pipeline A runs every day and pipeline B runs once in every month and it is dependent on pipeline A (pipeline B should trigger after successful completion of pipeline A).

Using scheduled trigger, we cannot have hard dependencies between 2 pipelines, where as with tumbling window, we cannot exactly specify the day which the pipeline B should run(it has only two options, minutes and hours where as scheduled trigger has months and weeks also)

Both the triggers has its disadvantages with respect to this scenario.

What could be the best possible solution for the above scenario?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,919 questions
{count} votes

Accepted answer
  1. Thomas Boersma 806 Reputation points
    2021-09-01T11:36:53.077+00:00

    Hi @SarvagnaPamidi-7119

    The first solution that comes to mind is to add an 'If Condition' to your pipeline A or create a new pipeline and add Pipeline A and the condition activity to it (as shown in the example). The adjusted or new pipeline should have a trigger on it that is set to every day. The 'If Condition' activity checks if the current date is the first of the month. If so, it should activate your pipeline B.

    Here is an example:
    128199-image.png

    The code in the If Condition activity could be: @equals(dayOfMonth(utcnow()), 1)

    Maybe there are better suited solutions, but I think it is not possible to succeed with only triggers. There should be a condition somewhere.

    Hope this helps.


0 additional answers

Sort by: Most helpful