Pipelines execution based on dependency

pankaj chaturvedi 86 Reputation points
2020-12-01T02:32:35.847+00:00

HI Team,

I have 3 pipelines and i want to execute based on dependency.

pipelines name: pl_test, pl_test_plan, pl_testcase.

step1:pipelines should execute first pl_test then pl_test_plan and pl_testcase.

step2: if pl_test_plan get fail and we do trigger the pipeline then pl_test should not be execute because its already executed.

step 3.in the same way if pl_testcase get fail then pl_test, pl_test_plan should not execute because it already executed

Basically pipeline should not execute which already got succeeded, it should start from the point of failure.

Could you please someone help me on it, if someone has already implemented the same.

I am looking forward your response.

Regards,
Pankaj

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,624 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. HimanshuSinha-msft 19,381 Reputation points Microsoft Employee
    2020-12-01T22:36:57.527+00:00

    Hello @pankaj chaturvedi ,

    Thanks for the ask and as I understand , the logic which you want is if any acticity which has failed in the last trigger that activity should not be execute in the current run , let me know if thats not accurate ?

    If my understanding is right , you will have a capture the state of each activity ( may be you can use SQL Table for that ) and then for every run you will have to check the last run and depending upon how it worked in the last run it will either execute or just by-pass the activty . I think we can use lookup( to check the last activity state ) , for each ( may be ) and if activity to implemented this .

    Let me know as to how it goes .

    Thanks
    Himanshu