Azure Data Factory Data Flow with Managed Identity Storage Account (error: 409)

Question

Accessing Blob Storage Account with Azure Data Factory Data Flow works when using Access Key as Authentication Method, however when accessing the same Storage Account with Managed Identity as Authentication Method the following error occurs in Debug mode:

at Source 'ServiceContractHeader': org.apache.hadoop.fs.FileAlreadyExistsException: HEAD https://<REDACTED>.dfs.core.windows.net/<REDACTED>//?action=getAccessControl&timeout=90
StatusCode=409
StatusDescription=This endpoint does not support BlobStorageEvents or SoftDelete. Please disable these account features if you would like to use this endpoint.
ErrorCode=
ErrorMessage=

Answer 1

Hello @Anonymous ,

Welcome to the Microsoft Q&A platform.

As per the Managed identities for Azure resource authentication document:

To resolve this issue, you have couple of options:

Option1: Disable soft delete option

As your storage account is enabled for soft-delete. Please disable as it is not supported in Azure Data Flows.

Option2: Changing the linked service type for a source file from Azure Data Lake Storage Gen2 to Azure Blob Storage in the linked service.

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.