Passing data from Azure Data Factory into Azure ML

Ilze Amanda 21 Reputation points
2021-07-16T14:00:50.49+00:00

In Azure ML the input data has to be defined as a Dataset (to create a pipeline). In my code I am passing datasets with the following syntax: input_data = Dataset.File.from_files(datapath)

I would like to change this datapath as an input parameter from Data Factory (for example via PipelineParamater), so I can apply the same Data Factory pipeline for different datasets. However, in Data Factory you can only pass string as a parameter, not a DataPath.

What is the solution around this?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,333 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator
    2021-07-19T11:14:55.843+00:00

    Hi @Ilze Amanda ,

    Thank you for posting your query on Microsoft Q&A Portal and sharing clarifications on ask.

    Unfortunately, we cannot create user defined types in Azure data factory at this moment.

    But, I will encourage you to log your feedback using below link. Product team will actively monitor feedback there and consider them for future releases. Thank you.
    https://feedback.azure.com/forums/270578-data-factory

    Hope this will help.

    --------------------------------------

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.