Getting below error while running a Copy Data activity in ADF

Question

ErrorCode=AzureBlobOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Blob operation Failed. ContainerName: raw, path: SYSTEM/FULL/.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (403) Forbidden.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=RequestId:c16a617a-c01e-0078-39d9-764214000000 Time:Mon, 12 Jul 2021 04:48:07 GMT,,''Type=System.Net.WebException,Message=The remote server returned an error: (403) Forbidden.,Source=System,'

Please suggest something to debug this issue.

Answer 1

Hi @Sushant Parihar ,

Welcome to Microsoft Q&A forum and thanks for your query.
As @Nandan Hegde pointed, from the error message it is an issue related to your blob access permission.

Also please check your blob storage “Firewalls and virtual networks”. If Selected networks is checked, please try checking All networks. If you want to enable firewall then please make sure to whitelist the IP's that need to access your storage account.

In case if you are using Service principal authentication, make sure to grant the service principal proper permission in Azure Blob storage. For more information on the roles, see Use the Azure portal to assign an Azure role for access to blob and queue data.

• As source, in Access control (IAM), grant at least the Storage Blob Data Reader role.
• As sink, in Access control (IAM), grant at least the Storage Blob Data Contributor role.

Reference documents:

• If it is Azure Storage please refer to this doc for more info - Copy and transform data in Azure Blob storage by using Azure Data Factory
• If it is Azure Data lake storage gen2 then please refer to this doc for more details - Copy and transform data in Azure Data Lake Storage Gen2 using Azure Data Factory

Hope this info helps. Do let us know how it goes or if you have further query.

----------

Please don’t forget to Accept Answer and Up-Vote wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Try and upload a random text file to the root container of your path. If this fails, it may be an issue with your container. This might occur if you create a storage account with hierarchical namespace disabled and later enable it.

Solution will be to create another container if this is the case.