Running external machine learning models in Adf pipelines

Question

Is it possible for Azure Data Factory to directly run advanced machine learning models, like those made with TensorFlow or PyTorch, within its own pipelines without needing to use Azure Machine Learning or other specific Azure services?

Answer 1

Hi @Glasier-3173

Welcome to Microsoft Q&A Platform. Thank you for posting your query.

Azure Data Factory cannot directly run advanced machine learning models, like those created with TensorFlow or PyTorch, on its own. To use such models in ADF, you need to connect and work with specific Azure services like Azure Machine Learning.

However, you can use Azure Machine Learning to train your models and then deploy them as web services. You can then use Azure Data Factory to call these web services as part of your pipeline.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.