Authentication failed when accessing dataset in compute instance using its MSI via AzureML SDK v2

Shiyao Li 0 Microsoft Employee

The dataset can be previewed in AML workspace when the associated datastore is created using identity-based auth with workspace managed identity. I have the same user managed identity assigned to workspace and compute instance. But it only failed in compute instance while using below code snippet to access the dataset.

# Set your subscription, resource group and workspace name:

subscription_id = "xxx"

resource_group = "xxx"

workspace = "xxx"

# connect to the AzureML workspace

ml_client = MLClient(

DefaultAzureCredential(), subscription_id, resource_group, workspace

)

filedataset_asset = ml_client.data.get(name="xxx", version="1")

tbl = mltable.load(f'azureml:/{filedataset_asset.id}')

df = tbl.to_pandas_dataframe()

df

Amira Bedhiafi 26,656

Your issue can be due to several reasons :

The user-managed identity is not properly assigned to both the Azure Machine Learning workspace and the compute instance.

The user-managed identity has the necessary roles assigned to access the ADLS, common roles required are Storage Blob Data Reader or Storage Blob Data Contributor for read or read/write access, respectively.

Example of how to use ManagedIdentityCredential():


from azure.identity import ManagedIdentityCredential

from azure.ai.ml import MLClient

# Set your subscription, resource group and workspace name

subscription_id = "xxx"

resource_group = "xxx"

workspace = "xxx"

# Use ManagedIdentityCredential for user-managed identity

credential = ManagedIdentityCredential(client_id='your_user_managed_identity_client_id')

# Connect to the AzureML workspace

ml_client = MLClient(credential, subscription_id, resource_group, workspace)

# Access the dataset

filedataset_asset = ml_client.data.get(name="xxx", version="1")

tbl = mltable.load(f'azureml:/{filedataset_asset.id}')

# Convert to pandas dataframe

df = tbl.to_pandas_dataframe()

df

If you still need help, don't forget to approach Azure support for further assistance.

Share via

Authentication failed when accessing dataset in compute instance using its MSI via AzureML SDK v2

Your answer