How to skip wait in "Rerun from specific activity" in ADF?

Tommy Tan 61 Reputation points Microsoft Employee
2023-05-24T05:47:37.7833333+00:00

User's image

In the official documents, it mentioned that some activities such as Wait/Until would not be skipped in rerun. Is there any workaround? How to implement a specific activities similar as wait/sleep and could be skipped in rerun, or how could we consolidate some activities as a whole?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,087 questions
{count} votes

Accepted answer
  1. KranthiPakala-MSFT 46,437 Reputation points Microsoft Employee
    2023-05-26T00:20:14.26+00:00

    @Tommy Tan Thanks for using Microsoft Q&A forum and posting your query.

    As mentioned in the public document until/wait would not be skipped in rerun.

    Below are couple of already logged feature request on the same use case. Please feel free to up-vote and comment to help increase the priority of feature request.

    Support skip wait activity when rerunning from failed activity/selected activity Skip successful pipeline activities when rerunning if said pipeline has not changed

    As a workaround, what I was thinking was to create a pipeline parameter let's say paramSkipWait or paramSkipUntil and set it default value to 'N' which means this will be used to set the condition in an if Condition Activity. And based on the condition output you can define the flow. Where if condition evaluates to true (for param value 'N'), then don't skip until activity and likewise, if condition evaluates to false then skip until activity and proceed with next flow of activities.

    User's image

    This parameter paramSkipUntil value can be updated when you rerun the pipeline.

    User's image

    Hope this workaround helps. let us know how it goes.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful