ADF Tumbling Window Trigger:Dependency trigger not triggering properly

2020-09-22T15:54:25.197+00:00

Hello,
I have created a tumbling window trigger for my Azure Data Factory Pipeline Test_Daily with recurrence as 24 hours. For this pipeline, i have added a dependency trigger lets say Test_Hourly (which runs every hour) with offset as 1.00:00:00(1 day).

Test_Daily pipeline is not getting triggered even though the dependency trigger has run successfully. For example, if the daily pipeline windowStartTime is 2020-09-20 00:00:00 and Test_Hourly with WindowStartTime 2020-09-21 00:00:00 has run successfully, then the daily pipeline should get triggered. However, this is not the case and Test_Daily gets triggered only when Test_Hourly has completed 2020-09-22 00:00:00(i.e. with 2 day offset).

Please let me know how to resolve this issue. Thanks.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,133 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HarithaMaddi-MSFT 10,126 Reputation points
    2020-09-24T15:24:32.527+00:00

    Hi @Prajval Ramesh (Cognizant Worldwide Limited) ,

    Thanks for your patience.

    I discussed with Product team and they confirmed that the tumbling window trigger starts at window end time (For daily pipeline it is 2020-09-21 00:00:00) and it adds offset (1 day) to it and pipeline actually runs at 2020-09-22 00:00:00.

    The same is replicated when I have used hourly and 5minute triggers. In this case, hourly is dependent on 5minute trigger with an offset of 5minutes and the delay of 5min after window time is seen in triggering time of hourly trigger.

    Hope this clarifies the query. Please let us know for further queries and we will be glad to assist.