Rerun ADF Tumbling Window Trigger with changed pipeline

Question

Hi!
I am using a set of Azure Data Factory pipelines for my daily ETL tasks. Two separate pipelines are used to load data from two different source systems, another one is used to transform and join those daily data from the different data sources and yet another one is used to prepare the data for reporting in Power BI. I have orchestrated the overall process by using tumbling window triggers with dependencies. Now I there was an issue in one of my loading pipelines. The issue was leading to an error, so the later pipelines of my process (transformation and preparation of the reporting layer), are still waiting for their dependencies.
Now I have corrected the pipeline and want to rerun the process for the last few days, where the error had an impact.
The change I had to make was simply changing default parameters (which in my case were not passed by the tumbling window trigger).
It seems natural, that rerunning the failed triggers for the past day would heal the problem. But apparently the trigger reruns still trigger the old (unchanged) version of the pipeline.
Is there a way to tell ADF, that I want to run the correct version of the pipeline, or do I have to execute all my failed pipelines and their dependencies manually?
BR Alfred

Answer 1

Hello @Gieger, Alfred ,

Welcome to the MS Q&A platform.

Please correct me if my understanding is wrong. You have added parameters to your pipeline and passing value to your tumbling window trigger and published. Re-running the pipeline is not picking up the latest version.

A similar thread has been discussed here. This is expected behavior.

The workaround is: Go to the pipelines and manually trigger them by passing the appropriate values.

(or)
via using rerun range
Triggers > rerun range, and specifying the value

I hope this helps. Please let me know if you have any further questions.

------------------------------

• Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators