Data flow sink shows that 892 rows are to be written but writes nothing to blob storage when triggered

Question

I have noticed a peculiar behavior with the ADF data flows.

While previewing the data to be written (I have set the debug row limit accordingly), it shows that 892 rows are to be written into my blob storage:

But, when I actually trigger the dataflow in a pipeline it writes nothing. The created files are empty. The consumption after running the data flow:

The actual blob storage:

Also, depending on the data coming from the source system, it happens that it writes something. But there is always a mismatch of rows. The preview shows more rows than it actually writes. (I know for a fact, after comparing the source system with the target system, that this data still needs to be written.) I have tried sorting the data beforehand and using single partition. Nothing has helped so far.

Answer 1

Hello @Anxhela Merko , Thanks for the question and using MS Q&A platform. Thats kind of strange, the only think which stands out to me may be the Errors configuration . Can you please check on your end and see if that's set?

Himanshu Please accept as "Yes" if the answer provided is useful , so that you can help others in the community looking for remediation for similar issues.