Creating a trigger for a dependency pipeline

Question

Creating a trigger for a dependency pipeline

Kirti Chaturvedi 116 Microsoft Employee

I have two pipelines one which run weekly, and another one that run every 5 minutes, Both pipeline use the same database. Now the weekly one I want it to be dependent on the 5-minute pipeline i.e the weekly one should run only when the Incremental one succeeded. And while the weekly one is running the incremental one should not run.

I tried creating a tumbling window trigger by putting dependency on 5 minute one,

When i changed it to 00:02:00, it changes it back to 0:03,

I am not able to create the dependency trigger. Is there a way to solve this scenario?

Thanks

KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-11-23T04:10:44.117+00:00

Hello @Kirti Chaturvedi ,

Thanks for the question and using MS Q&A platform.

Could you please confirm if you are using two different tumbling window triggers for each pipeline and creating dependency? I would recommend going through this demo from one of my colleagues where detailed description is provided on how to configure the dependency for TWT in ADF/Synapse.

Looks like your offset and window size configuration is causing the issue.

Please have a look at the demo and let me know if you still have questions in configuring TWT for your requirement: Tumbling Window Trigger Dependency in Azure Data Factory

Hope this info helps.
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-12-02T21:20:41.41+00:00

Hello @Kirti Chaturvedi ,

Just checking in to see if the video demonstration was helpful to resolve your issue. And, if you have any further query do let us know.

1 answer

Your answer

KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-11-23T04:10:44.117+00:00

Hello @Kirti Chaturvedi ,

Thanks for the question and using MS Q&A platform.

Could you please confirm if you are using two different tumbling window triggers for each pipeline and creating dependency? I would recommend going through this demo from one of my colleagues where detailed description is provided on how to configure the dependency for TWT in ADF/Synapse.

Looks like your offset and window size configuration is causing the issue.

Please have a look at the demo and let me know if you still have questions in configuring TWT for your requirement: Tumbling Window Trigger Dependency in Azure Data Factory

Hope this info helps.
KranthiPakala-MSFT 46,737 Reputation points Microsoft Employee Moderator

2022-12-02T21:20:41.41+00:00

Hello @Kirti Chaturvedi ,

Just checking in to see if the video demonstration was helpful to resolve your issue. And, if you have any further query do let us know.

Answer 1

Kirti Chaturvedi 116 Microsoft Employee

That did not solve my issue, but what I did was I created an if condition in 1 pipeline to run the other pipeline when needed.
thanks

Share via

Creating a trigger for a dependency pipeline

1 answer

Your answer