Register Data Sets in Azure ML

Question

Register Data Sets in Azure ML

Lukas 151

Hello dear Microsoft Q&A Team,

I'm new to Azure ML and have the following problem: I can't create data assets using a datastore. I did the following:

I created a datastore which points on my adls gen2 datalake using a service principal. I assigend all Storage Blob Data rolls (of the ressource group of the datalake) to this service principal. But when I try to create a dataset using this datastore the storage path does not load:

Any idea what I'm doing wrong?

romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2022-10-12T11:31:16.833+00:00

@Lukas Did you add the role Storage Blob Data Contributor to your ADLS Gen2 storage account?
From the storage account resource's Access Control (IAM) tab -> Add role assignment -> Assign access to -> select registered application and role Storage Blob Data Contributor. Once this is complete you should be able to use the Service Principal to use the ADLS Gen2 data. If a simple mount works, then I think the above access should also work from ML studio.

Please refer this thread for details on how to configure and use SI with ADLS Gen2 storage account.
Lukas 151 Reputation points

2022-10-12T13:33:57.737+00:00

Thank you for your answer, but the ADLS Gen2 storage account already had the Storage Blob Data Contributor role. I double checked all role assignments. It is still not working. To make it even more mysterious: I could create one, but only one, dataset. But after this, it never worked again.
romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2022-10-21T05:19:02.047+00:00

Apologies @Lukas I could not get back earlier on this. It is interesting that you could create one but it fails to load again. If the issue still persists, I will request to report the same through ML portal ml.azure.com using the smiley icon on the top right corner. This will enable the service team to get back to you after checking the screenshot submitted.

1 answer

Your answer

romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2022-10-12T11:31:16.833+00:00

@Lukas Did you add the role Storage Blob Data Contributor to your ADLS Gen2 storage account?
From the storage account resource's Access Control (IAM) tab -> Add role assignment -> Assign access to -> select registered application and role Storage Blob Data Contributor. Once this is complete you should be able to use the Service Principal to use the ADLS Gen2 data. If a simple mount works, then I think the above access should also work from ML studio.

Please refer this thread for details on how to configure and use SI with ADLS Gen2 storage account.
Lukas 151 Reputation points

2022-10-12T13:33:57.737+00:00

Thank you for your answer, but the ADLS Gen2 storage account already had the Storage Blob Data Contributor role. I double checked all role assignments. It is still not working. To make it even more mysterious: I could create one, but only one, dataset. But after this, it never worked again.
romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2022-10-21T05:19:02.047+00:00

Apologies @Lukas I could not get back earlier on this. It is interesting that you could create one but it fails to load again. If the issue still persists, I will request to report the same through ML portal ml.azure.com using the smiley icon on the top right corner. This will enable the service team to get back to you after checking the screenshot submitted.

Answer 1

Lukas 151

Hello @romungi-MSFT ,

no worries. I was able to create a data set, but had to enter the file path manually:

For me it is fine, but I think it still not working the way it should be.

Cheers

Lukas

Lukas 151 Reputation points

2022-10-21T07:51:43.863+00:00

BTW: Is there a way to delete data sets? I only can archiv them, but then the name is still occupied.

Share via

Register Data Sets in Azure ML

1 answer

Your answer