Unable to profile dataset in ML. The source is ADLS. Error showing as authentication problem

Krishnamohan Nadimpalli 406 Reputation points
2023-02-23T03:52:11.23+00:00

Hi All

I have a ML Workspace and an ADLS Account . I created the data store and dataset manually in ML Workspace. But while profiling the dataset , error shows as below

Error Message: ScriptExecutionException was caused by StreamAccessException.
  StreamAccessException was caused by AuthenticationException.
    'AdlsGen2-ReadHeaders' for 'https://dlsdevdatafizzaml002.dfs.core.windows.net/alb/iris.csv' on storage failed with status code 'Forbidden' (This request is not authorized to perform this operation.), client request ID 'b5c8a43a-9eb6-4b0e-ac05-4765330df3d0', request ID '83bb1721-401f-0077-3e38-476a01000000'. Error message: 
| session_id=ff44f9a7-2fcf-4d2e-84a7-5bfcd37ca08f

I have given Managed Identity of ML Workspace to ADLS with Reader, Storage Blob Data Reader and Storage Blob Data Contributor access.

While creating the Datastore, I have given Service Principal Details. And the Service Principal is given Storage Blob Data Contirbutor accees to ADLS.

I do not think of anything above with respect to authentication. But not sure if this is really a authentication issue. Please help on this

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,562 questions
Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,340 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.