Error while setting up a schedule on Azure ML Dataset Import Job

Question

Error while setting up a schedule on Azure ML Dataset Import Job

Avni Bhatt 0

I have setup a data asset to import data from Snowflake to Azure ML table. This runs perfectly fine when I setup without any schedule in place. However, as soon as I setup a recurring schedule, no matter what schedule I pick - every week, Month, hour or cron expression, it errors out during "Create" with "Error: Your request to create data import schedule has failed." . As soon as i delete schedule configuration, it creates successfully. I am using UI for setting this up and not CLI or SDK.

I am referring to these steps :

https://learn.microsoft.com/en-us/azure/machine-learning/how-to-schedule-data-import?view=azureml-api-2&tabs=azure-studio

Manas Mohanty 5,700 Microsoft External Staff Moderator

Hi Avni Bhatt

It seems you are having issue to running data import jobs with schedules. It points towards possible missing permission on scheduling jobs.

Could you confirm whether you have owner or contributor or Data Scientist role or your custom roles have below permissions

Action	Description	Rule
Read	Get and list schedules in Machine Learning workspace	Microsoft.MachineLearningServices/workspaces/schedules/read
Write	Create, update, disable and enable schedules in Machine Learning workspace	Microsoft.MachineLearningServices/workspaces/schedules/write
Delete	Delete a schedule in Machine Learning workspace	Microsoft.MachineLearningServices/workspaces/schedules/delete

Reference on permission for scheduling jobs

Manage Roles and permission for ML

Could you go to the failed pipeline and share output+logs zip in private message.

Thank you

Avni Bhatt 0 Reputation points

2025-04-21T00:34:38.6533333+00:00

Thank you. While setting up the data asset, i had used "Workspace Managed datastore". In such imports, I am not able to navigate to that datastore. If I select "Other Datastores" and setup manually, then I am able to manage schedules. How to setup permission when "Workspace Managed Datastore" is selected? as it doesnt allow to navigate to associated data store in this case.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-21T11:47:55.1433333+00:00

Hi Avni Bhatt

Sorry for the late reply.

I am also not able to view the data with workspace managed datastore. will check and update you on it after reviewing with team internally.

But most of the times we suggest customer to provide "Storage Blob Data Contributor " for users and workspace over the container with which datastore are being created

They normally provide storage reader/ Storage blob reader access and preferable when used in virtual network protected workspaces by default.

Workspace managed datastore are useful when you want to automatically managed Lifecyle of data import.

Reference on life cycle management

Thank you.
Avni Bhatt 120 Reputation points

2025-04-22T12:09:51.32+00:00
Hello Manas,

Using "Other Datastores" , I am able to save schedule. However, that makes me wonder of two things:

What is benefit of workspace managed store then?

MS should disable schedule option in that case as the error message is also not helpful to deduce that what us the root cause!

But for now, I am able to proceed with "Other Datastores".

Thank you!
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-22T13:45:18.8866667+00:00

Hi Avni Bhatt

Workspace managed datastore manage lifecycle and permission of storage account.

By default, it provides storage reader/ Storage blob reader access on storage.

Work around- Providing "Storage contributor Storage Blob Data Contributor " for users and workspace over the container with which datastore are being created should make the data viewable and possible fix the schedule issue too.

But thank you for pointing out the default behavior and will discuss with team and do the needful.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-23T08:50:26.2133333+00:00

Hi Avni Bhatt

Hope the pointers shared have been useful to you. Please take a minute to accept below answer if they were helpful

Thank you.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-24T05:33:21.59+00:00

Hi Avni Bhatt

We have not heard from you. Hope the pointers shared were useful to you.

Thank you.

1 answer

Your answer

Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-18T12:18:25.13+00:00

Hi Avni Bhatt

It seems you are having issue to running data import jobs with schedules. It points towards possible missing permission on scheduling jobs.

Could you confirm whether you have owner or contributor or Data Scientist role or your custom roles have below permissions

Action Description Rule

Read Get and list schedules in Machine Learning workspace Microsoft.MachineLearningServices/workspaces/schedules/read

Write Create, update, disable and enable schedules in Machine Learning workspace Microsoft.MachineLearningServices/workspaces/schedules/write

Delete Delete a schedule in Machine Learning workspace Microsoft.MachineLearningServices/workspaces/schedules/delete

Reference on permission for scheduling jobs

Manage Roles and permission for ML

Could you go to the failed pipeline and share output+logs zip in private message.

Thank you
Avni Bhatt 0 Reputation points

2025-04-21T00:34:38.6533333+00:00

Thank you. While setting up the data asset, i had used "Workspace Managed datastore". In such imports, I am not able to navigate to that datastore. If I select "Other Datastores" and setup manually, then I am able to manage schedules. How to setup permission when "Workspace Managed Datastore" is selected? as it doesnt allow to navigate to associated data store in this case.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-21T11:47:55.1433333+00:00

Hi Avni Bhatt

Sorry for the late reply.

I am also not able to view the data with workspace managed datastore. will check and update you on it after reviewing with team internally.

But most of the times we suggest customer to provide "Storage Blob Data Contributor " for users and workspace over the container with which datastore are being created

They normally provide storage reader/ Storage blob reader access and preferable when used in virtual network protected workspaces by default.

Workspace managed datastore are useful when you want to automatically managed Lifecyle of data import.

Reference on life cycle management

Thank you.
Avni Bhatt 120 Reputation points

2025-04-22T12:09:51.32+00:00

Hello Manas,

Using "Other Datastores" , I am able to save schedule. However, that makes me wonder of two things:

What is benefit of workspace managed store then?

MS should disable schedule option in that case as the error message is also not helpful to deduce that what us the root cause!

But for now, I am able to proceed with "Other Datastores".

Thank you!
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-22T13:45:18.8866667+00:00

Hi Avni Bhatt

Workspace managed datastore manage lifecycle and permission of storage account.

By default, it provides storage reader/ Storage blob reader access on storage.

Work around- Providing "Storage contributor Storage Blob Data Contributor " for users and workspace over the container with which datastore are being created should make the data viewable and possible fix the schedule issue too.

But thank you for pointing out the default behavior and will discuss with team and do the needful.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-23T08:50:26.2133333+00:00

Hi Avni Bhatt

Hope the pointers shared have been useful to you. Please take a minute to accept below answer if they were helpful

Thank you.
Manas Mohanty 5,700 Reputation points Microsoft External Staff Moderator

2025-04-24T05:33:21.59+00:00

Hi Avni Bhatt

We have not heard from you. Hope the pointers shared were useful to you.

Thank you.

Answer 1

Manas Mohanty 5,700 Microsoft External Staff Moderator

Hi Avni Bhatt

We are waiting for your inputs. Please let us know if the above pointers have been able to clear your doubts.

I am able to view the data inside after adding Storage blob contributor to my email address from storage container IAM. I have disabled "Save credentials in datastore for data access " though.

Attached screenshots for reference.

Screenshot (95)

Screenshot (96)

Please let us know if it fixes the issue on scheduling the jobs too.

Thank you.

Avni Bhatt 120 Reputation points

2025-04-24T05:35:24.5433333+00:00

Hi Mohan,yes after setting up Other datastore , I was able to set schedule. Thank you.

Share via

Error while setting up a schedule on Azure ML Dataset Import Job

1 answer

Your answer