How to set Dependencies among pipelines

Question

I have 3 pipelines A, B and C .

I am calling Pipelince C from B.

Now I want an activity in Pipeline C which will check whether pipeline A has completed succesffuly or not .

If A has not completed successfully , recheck again after some interval and on completion of pipeline A proceed with pipeline C ,complete other activities in Pipeline C.

Can anybody help me to achieve this,please?

Answer 1

Hi Gulhasan.Siddiquee,

Thank you for posting query in Microsoft Q&A Platform.

We can create dependent pipelines in ADF, using Tumbling window triggers.

There are two approaches, which I can think of for this requirement.

Approach 1: Create tumbling window trigger for Pipeline A & Pipeline B(consider Pipeline C is executing inside B). Now in Pipeline B tumbling window trigger we add dependency for Pipeline A tumbling window trigger.

Please check below videos to understand tumbling window triggers and dependencies.

Tumbling Window Trigger in Azure Data Factory

Tumbling Window Trigger Dependency in Azure Data Factory

Approach 2: In pipeline C, use Until activity, Inside Until activity, have Web activity that makes API call to Pipeline A to check execution status. Once execution status from API is successful, come out of until activity and proceed further.

Until Activity in Azure Data Factory

Below is the REST API to get pipeline run status:

https://learn.microsoft.com/en-us/rest/api/datafactory/pipeline-runs/get?tabs=HTTP

Hope this helps.

---

Please consider hitting Accept Answer button. Accepted answers help community as well.