How to Trigger ADF pipeline from another ADF?

Question

I'm trying to trigger one adf(transformation) pipeline from another adf(ingestion) pipeline, Both the adf's are under same subscription but different resources. We don't want to use even hubs. I'm looking for alternative solutions.

Answer 1

Hi @Santosh ,

Thank you for posting query in Microsoft Q&A Platform.

You run pipeline of another ADF from your ADF using web activity.

As mentioned earlier, below video has detailed steps for same.
https://www.youtube.com/watch?v=wbURJiKoBlg

From your error message it seems you have not granted roles or permissions correctly.

Please check below example, to understand it better.

Lets say, you have ADF1 which contains Pipeline1. And you have ADF2 which contains a pipeline2. Now your requirement is to run Pipeline1 of ADF1 from Pipeline2 of ADF2.

In this case, you should make sure that, inside ADF1 Access control, assign contributor role for ADF2. Once roles assigned make sure to wait to 10 to 15 mins and then try to run and see.

Hope this helps. Please let me know if any concerns.

------------------

Please consider hitting Accept Answer. Accepted answers help community as well.

Answer 2

Hey,
You can trigger an ADF pipeline from another ADF pipeline via Web activity through ADF REST API :
https://medium.com/@rajbca00/execute-azure-adf-pipeline-using-rest-api-76d6cee5c473
'/createRun?api-version=2018-07-01-preview'

Another way is you can create a file at the end of 1st pipeline and then use event trigger in another pipeline.

Answer 3

@ShaikMaheer-MSFT We have given contributor access to Source adf over target adf, we getting authorization failed error. Both adfs are under same subscriptions but different resource groups. Need help to understand this error. Thanks!