Queue TumblingWindowTrigger

Question

Hi all,
we have a scenario using a TumblingWindowTrigger for ADF that runs every 10 minutes with no concurrency, so just one trigger will be fired.

After 10 minutes, if the pipelines is still running the following pipelines go in a queue and after the first one is completed, they'll fire subsequently.
Is it possibile to avoid the queue, so if a pipeline is running, the next triggers fail? So no elements in queue.

Thanks
Martin

Answer 1

Hello @Anonymous ,

Thanks for the question and using MS Q&A platform.

To better assist on this query, could you please help me understand what is the business requirement or the need to fail the queued runs?

Tumbling window trigger is a more heavy weight alternative for schedule trigger offering a suite of features for complex scenarios(dependency on other tumbling window triggers, rerunning a failed job and set user retry for pipelines). If your business requirement does not belong to any of these scenarios, then you could use a Schedule trigger scheduled for every 10 minutes and then within your pipeline you can have a web activity to make an api call to check if there are any active pipeline runs for that particular pipeline and then have an IF condition activity and based on that result from web activity you can check if there are any active runs for that pipeline or not. If there is an active run then fail the pipeline else continue the flow.

Let us know if your requirement does not fit with schedule trigger.

Thank you