tumbling-window-trigger-dependency(Azure Data Factory)

pankaj chaturvedi 86

Hi Team,

How to create dependent pipelines in your Azure Data Factory using tumbling window trigger.?

I created the triggers and assigned dependency ,also activated the triggers but triggers not executing the pipelines by given start date and end date.

I followed below given tutorials:

https://www.youtube.com/watch?v=8X4CGsIuxGg&ab_channel=WafaStudies

https://learn.microsoft.com/en-us/azure/data-factory/tumbling-window-trigger-dependency

Could you please let me know if someone has implemented the same or if anyone have idea.

I am looking forward your response.

Thanks,
Pankaj

pankaj chaturvedi 86 Reputation points

2020-12-08T05:37:37.593+00:00

Hi Team, Could you please respond here. Thanks!
pankaj chaturvedi 86 Reputation points

2020-12-08T10:11:10.32+00:00

Hi Team, I am looking forward your response.

1 answer

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-08T11:16:15.457+00:00
Hi @pankaj chaturvedi ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

The dependency in the tumbling window triggers is working as expected as below. In this snap, trigger4 is dependent on trigger3 and is using dependency offset as 0 and window size for both of the triggers is 5minutes.

There is a default offset on trigger time (5minutes) compared to window start time , the same can be observed below.

Please let us know for specific queries and we will be glad to assist further.

----

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.
Please sign in to rate this answer.
pankaj chaturvedi 86 Reputation points

2020-12-08T11:31:18.563+00:00

Hi Haritha, Thank you for your response. Could you please attach the screenshot for creation of tumbling window trigger and assigned dependency as i am attaching for reference. May be i am missing something.Thanks!

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-08T12:32:16.07+00:00

Thanks @pankaj chaturvedi . Sure, please find below the screenshots of trigger configurations. Please share more details on the issue you are observing with the trigger times so that we can assist further.

Trigger3:

Trigger4:

pankaj chaturvedi 86 Reputation points

2020-12-08T12:49:47.16+00:00

Thanks Haritha, the issue which i am facing is that my trigger execution is not happening on given Start Date so because of that my pipeline is not triggered and also i didn't trigger the tumbling window trigger manually because it should trigger on given time automatically at the time of creation. Are you triggering manually first time for execution?

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-08T13:30:56.86+00:00

Thanks @pankaj chaturvedi for providing the details. I did not trigger manually. Usually the trigger windows > start date specified in trigger configuration are only executed. Ex: Start date is 10.51am in below trigger setup, so any trigger windows overlapping with 10.51 time are not picked and same with both the triggers. Also, please check if publish happened appropriately for the triggers and pipelines. Please retry on new set of pipelines and triggers as well and let us know if issue persists.

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-09T15:33:10.883+00:00

Hi @pankaj chaturvedi ,

We have not received a response from you. Are you still facing the issue? If you found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members

HarithaMaddi-MSFT 10,136 Reputation points

2020-12-14T15:44:00.697+00:00

Hi @pankaj chaturvedi ,

We still have not heard back from you. Are you still facing the issue? If you found a solution, would you please share it here with the community? Otherwise, let us know and we will continue to engage with you on the issue.

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

tumbling-window-trigger-dependency(Azure Data Factory)

1 answer

Your answer