While runnig Synapse Pipeline getting Directory Non Empty Error.

arindam.pandit 101 Reputation points
2021-04-29T08:03:14.443+00:00

Hi, I am using synapse pipeline and sink component is writing files in a stage location. It is been able to successfully write the files but I throws the following error message.

Error: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'QcRxFactData': org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: This operation is not permitted on a non-empty directory.","Details":"at Sink 'QcRxFactData': org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: This operation is not permitted on a non-empty directory."}

Any help will be highly appreciated.
Regards,
Arindam Pandit

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,362 questions
{count} votes

Accepted answer
  1. arindam.pandit 101 Reputation points
    2021-04-30T06:07:23.567+00:00

    It was resolved. The problem was in connector. We were using DLG2 but while creating the Linked Service, as connector we choose Blob Connector. Replacing the connector solved the issue.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful