Are there any Limitations to use Tumbling window Trigger in Azure Data Factory?

Question

Hi All,

I have multiple pipelines dependent on each other, I want to use Tumbling window trigger. Requesting you to suggest me Is it right approach? or Are there any Limitations to use it.

Regards,
Ashok

Answer 1

Hi @Ashok Kumar Bollineni ,

Thanks for reaching out. In addition to above inputs from anonymous userChaudhari, please see below related info.

Tumbling window triggers are a type of trigger that fires at a periodic time interval from a specified start time (basically when you want to process a time based data), while retaining state. Tumbling windows are a series of fixed-sized, non-overlapping, and contiguous time intervals.

This triggers offer a suite of features for complex scenarios like :

• Dependency on other tumbling window triggers
• Rerunning a failed job and
• Set user retry for pipelines

Here are few Limitations:

• A tumbling window trigger has a one-to-one relationship with a pipeline and can only reference a singular pipeline.
• If one of the dependencies triggers fails, you must successfully rerun it in order for the dependent trigger to run.
• A tumbling window trigger will wait on dependencies for seven days before timing out. After seven days, the trigger run will fail

ADF also has another time based trigger called Schedule trigger. To know more in detail about the differences between a Schedule trigger and a Tumbling window trigger, please refer to this doc: Trigger type comparison

Related helpful docs: Tumbling window trigger Usage scenarios and examples

Hope this info helps.

----------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Tumbling window trigger can be use if you want to import time based data and process data based on time.

See the trigger types and use cases - https://www.cathrinewilhelmsen.net/triggers-azure-data-factory/

If you just have pipeline dependencies, then it should be ok to use Scheduled trigger. You can create a master pipeline and orchestrate/call pipelines by connecting them in series as you need and set up scheduled trigger on this master pipeline.

---

Please don't forget to Accept Answer and Up-vote if the response helped -- Vaibhav

Answer 3

1.In tumbling window you can't schedule your pipeline more specific timings like schedule trigger.

For Example:-

• You can't execute pipeline on weekdays or weekends by using tumbling window trigger but you can achieve by Schedule Trigger.
• You can't execute pipeline on specific multiple date's of any month by using tumbling window trigger. Reference Screenshot of Schedule trigger: Reference screenshot for Tumbling window:-

2.You can apply dependency up to 5 triggers only.

3. you can't keep frequency below 5 min of tumbling window trigger.