This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(105.60000000000001, 94%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Hello everyone!
Every time I debug my pipeline in ADF I get the following error on dataflow activity: "{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': org.apache.hadoop.fs.azure.AzureException: com.microsoft.azure.storage.StorageException: This operation is not permitted on a non-empty directory.""
The process is: I try to load XML file via API to the one folder in Azure BLOB Storage (ADLS Gen2) using COPY DATA activity, then to parse it to CSV using Dataflow and load the final csv file to the same container, but another folder in BLOB Storage. 
The COPY DATA activity runs successfully, I really get my xml file in Azure Storage. But when dataflow starts processing, it create a folder inside of my target folder with file having strange name and an empty folder and fails with error. 
In dataflow sink I set 'single partition' and 'output to single file', but seems like it doesn't work correctly. I also tried to set "clear the folder", but it didn't help.
Hope you have any ideas how to deal with this issue
Thanks for your help!
Open the monitoring view for the data flow activity. Take a look at how many rows were being written and also look for any failures in the data flow.
I opened but don't see any error descriptions 
Just that sink activity was succeeded, despite the fact that pipeline fails because of this sink 
Other activities in dataflow show me failures without any descriptions 
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Hello @Alina Sheiko ,
Just trying to understand the problem here, so your dataflow says 690 rows written but in the sink folder you are seeing an empty file created? But when you looked at the monitor section of the dataflow you see all transformations failed except the sink?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 22%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
Was there any resolution to this issue ? i am facing the same and its causing daily produciton failures . @KranthiPakala-MSFT and @Alina Sheiko
Are you using Blob or ADLS Gen 2 for the files? Make sure you are using the correct Linked Service type.
WE were so far using the blob storage type as our linked service which was working well till the 9th of June 2022 .
Use the ADLS Gen 2 Linked Service instead
ok . Sure working it out