Queue TumblingWindowTrigger

Question

Queue TumblingWindowTrigger

Martin Colombini 21

Hi all,
we have a scenario using a TumblingWindowTrigger for ADF that runs every 10 minutes with no concurrency, so just one trigger will be fired.

After 10 minutes, if the pipelines is still running the following pipelines go in a queue and after the first one is completed, they'll fire subsequently.
Is it possibile to avoid the queue, so if a pipeline is running, the next triggers fail? So no elements in queue.

Thanks
Martin

Martin Colombini 21 Reputation points

2022-03-31T09:20:01.867+00:00

Hi @KranthiPakala-MSFT ,

thanks for the reply!

So, can I check the status of my Pipelines only with api calls?

In my scenario I have cost limits that I have to respect and I would like to understand what I can do.

thanks,
Martin
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-01T04:57:47.567+00:00

Hello @Martin Colombini ,

Thanks for your response. Yes, if you would like to know the status of any pipeline at runtime, then you will have to use REST api to get the details. If your business requirement permits, see if you can increase the trigger frequency >10min. In case if 10 min frequency is necessary, then you will have to go with REST API route to have a check status condition and then execute the pipeline flow.

Hope this helps.
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-05T19:17:51.327+00:00

Hello @Martin Colombini ,

Just checking in to see if the above information was helpful. And, if you have any further query do let us know.
Martin Colombini 21 Reputation points

2022-04-07T13:56:25.417+00:00

Hello @KranthiPakala-MSFT ,

sorry for the delay in my answering.

Yes, it was very helpful, thanks for your quick reply, it helped me for my scenario!

Best regards,
Martin
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-07T21:37:17.777+00:00

Hello @Martin Colombini ,

Glad to know it was helpful. Hello @Martin Colombini . Thanks for confirming.

Have a good day! :)

----------

Please don't forget to click Accept Answer and Up-Vote on the thread that is helpful as it can be beneficial for others reading it.

Martin Colombini 21 Reputation points

2022-03-31T09:20:01.867+00:00

Hi @KranthiPakala-MSFT ,

thanks for the reply!

So, can I check the status of my Pipelines only with api calls?

In my scenario I have cost limits that I have to respect and I would like to understand what I can do.

thanks,
Martin
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-01T04:57:47.567+00:00

Hello @Martin Colombini ,

Thanks for your response. Yes, if you would like to know the status of any pipeline at runtime, then you will have to use REST api to get the details. If your business requirement permits, see if you can increase the trigger frequency >10min. In case if 10 min frequency is necessary, then you will have to go with REST API route to have a check status condition and then execute the pipeline flow.

Hope this helps.
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-05T19:17:51.327+00:00

Hello @Martin Colombini ,

Just checking in to see if the above information was helpful. And, if you have any further query do let us know.
Martin Colombini 21 Reputation points

2022-04-07T13:56:25.417+00:00

Hello @KranthiPakala-MSFT ,

sorry for the delay in my answering.

Yes, it was very helpful, thanks for your quick reply, it helped me for my scenario!

Best regards,
Martin
KranthiPakala-MSFT 45,982 Reputation points Microsoft Employee

2022-04-07T21:37:17.777+00:00

Hello @Martin Colombini ,

Glad to know it was helpful. Hello @Martin Colombini . Thanks for confirming.

Have a good day! :)

----------

Please don't forget to click Accept Answer and Up-Vote on the thread that is helpful as it can be beneficial for others reading it.

Answer 1

Hello @Martin Colombini ,

Thanks for the question and using MS Q&A platform.

To better assist on this query, could you please help me understand what is the business requirement or the need to fail the queued runs?

Tumbling window trigger is a more heavy weight alternative for schedule trigger offering a suite of features for complex scenarios(dependency on other tumbling window triggers, rerunning a failed job and set user retry for pipelines). If your business requirement does not belong to any of these scenarios, then you could use a Schedule trigger scheduled for every 10 minutes and then within your pipeline you can have a web activity to make an api call to check if there are any active pipeline runs for that particular pipeline and then have an IF condition activity and based on that result from web activity you can check if there are any active runs for that pipeline or not. If there is an active run then fail the pipeline else continue the flow.

Let us know if your requirement does not fit with schedule trigger.

Thank you

Queue TumblingWindowTrigger

0 additional answers

Activity