While runnig Synapse Pipeline getting Directory Non Empty Error.

asked 2021-04-29T08:03:14.443+00:00
arindam.pandit 101 Reputation points

Hi, I am using synapse pipeline and sink component is writing files in a stage location. It is been able to successfully write the files but I throws the following error message.

Error: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'QcRxFactData': org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: This operation is not permitted on a non-empty directory.","Details":"at Sink 'QcRxFactData': org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: This operation is not permitted on a non-empty directory."}

Any help will be highly appreciated.
Regards,
Arindam Pandit

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,603 questions
{count} votes

Accepted answer
  1. answered 2021-04-30T06:07:23.567+00:00
    arindam.pandit 101 Reputation points

    It was resolved. The problem was in connector. We were using DLG2 but while creating the Linked Service, as connector we choose Blob Connector. Replacing the connector solved the issue.


0 additional answers

Sort by: Most helpful