Azure Data Factory : Tumbling Window Trigger : Dependent Triggers not running
Hi All, This is regarding Window time of tumbling window trigger in ADF for orchestrating all the jobs. At a high level the problem is that - when we are scheduling tumbling window triggers with having back to back dependencies and setting a Window recurrence as 24 hours, all the dependent triggers are not running and going into “Waiting for Dependency” state (only the first one getting succeeded). However, when we are publishing the trigger and scheduled to run with shorter frequency (say 2 / 4 hours), it is running as expected (with different dates and monitored over a day). So far, we have around 50+ triggers and all triggers (expect the first one) has 1-1 or 1-n dependencies. T2 will start on completion of T1. Similarly T3, T4, T5 should start on completion of T2 etc. Also, there is a requirement that all triggers should run daily once and retry number as 3 with interval 3 mins - This requirement, we have already configured in Tumbling window triggers. Any advise / help how to configure all these will be highly appreciated. Thanks!! Kaushik
Hello @Dutta, Kaushik (Cognizant) and welcome to Microsoft Q&A. I'm sorry you are encountering these difficulties.
If I understand correctly, everything works perfectly when the cadence is less than a day, but when you set it to a day, things break.
I am uncertain whether I can provide timely service in this case, because each attempt to reproduce your scenario would take a day to test. In this light, I believe you would be better served opening a support ticket.
Please let me know if you need help opening a support ticket.
Thanks Martin for your quick response.
IThe issue i'm facing is really weird - I double-checked all the configurations and the dependencies. It is working fine in case of short term interval, however facing this issue when setting as 24 hours, publishing the triggers, say, today, start time as today and expected to run after 24 hours.
I agree, that it will take a day to replicate the scenario. Even, it took long time for me as well.
Would be great, if you can raise a support Ticket on my behalf, so that someone can look into this and provide me a resolution.
Thanks a lot !!!
Have you tried using 1 Day instead of 24 Hours?
I wish I could, @Dutta, Kaushik (Cognizant) , but support tickets are linked to customers. Support tickets allow for a more one-on-one communication, and may allow for deeper investigation than I can provide here.
You can open a support ticket via the Portal as shown below.
Sign in to comment