Azure ML Datastore\Datasets

Sun Shine 291 Reputation points


I want to know that if it is possible automate copy file from azure storage to Azure ML folder.

I understand that it is duplication of data, but I want to know if yes, how I can do that.

Any pointer is greatly appreciated.


Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,098 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,138 questions
{count} votes

Accepted answer
  1. romungi-MSFT 38,646 Reputation points Microsoft Employee

    Depending on the frequency at which you would like to move data you can create scripts that could run on crontab to move the data between source storage account to your workspace blob store. For example, use azcopy to perform this activity.

    A very comprehensive method to move storage between storage accounts is available as a Microsoft learn module that you could take to understand the possibilities and attain this from code to automate in your application.

    I would ideally assume that you would like to pull data when your experiment kicks off because you cannot move data to an experiments run id folder unless the experiment has started, In this case you could use the first option to place the data in your workspace blob store and then use it in your experiment without moving it to any other storage. I hope this helps.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful