Is it possible to call an Azure ML SDK v2 pipeline from within a Synapse pipeline? The synapse "machine learning execute pipeline" step requires a pipeline id or pipeline endpoint id, as seen below. However, based on the documentation, it doesn't seem possible to publish SDK v2 pipelines. Is there some way to either (i) publish an Azure ML SDK v2 pipeline or (ii) invoke an Azure ML SDK v2 pipeline from synapse? Thank you..

Call an Azure ML SDK v2 Pipeline from Synapse

Dance, Cody R. (ALT) 25

Is it possible to call an Azure ML SDK v2 pipeline from within a Synapse pipeline? The synapse "machine learning execute pipeline" step requires a pipeline id or pipeline endpoint id, as seen below.
User's image

However, based on the documentation, it doesn't seem possible to publish SDK v2 pipelines. Is there some way to either (i) publish an Azure ML SDK v2 pipeline or (ii) invoke an Azure ML SDK v2 pipeline from synapse?

Thank you..

romungi-MSFT 43,696 Reputation points Microsoft Employee

2024-03-27T09:12:09.46+00:00

@Dance, Cody R. (ALT) The concept of published pipelines changes with v2, Here is the mapping of v1 and v2 concepts.

With respect to Azure ML, a batch endpoint is similar to published pipeline, I am not sure how it is populated at synapse UI but I think it should show any batch endpoints.
Flurin Gishamer 0 Reputation points

2024-07-22T13:39:42.6233333+00:00
I have the same problem: I implemented all ML pipelines using SDK v2, which moved from "pipeline endpoints" to "batch endpoints".

As it seems, batch endpoints do not show up in Synapse "Machine Learning Execute Pipeline" step.

What is the recommended approach to execute ML pipelines (SDK v2) from Synapse?

Share via

Call an Azure ML SDK v2 Pipeline from Synapse