This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(294.40000000000003, 30%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
I have noticed a peculiar behavior with the ADF data flows.
While previewing the data to be written (I have set the debug row limit accordingly), it shows that 892 rows are to be written into my blob storage:
But, when I actually trigger the dataflow in a pipeline it writes nothing. The created files are empty. The consumption after running the data flow:
The actual blob storage:
Also, depending on the data coming from the source system, it happens that it writes something. But there is always a mismatch of rows. The preview shows more rows than it actually writes. (I know for a fact, after comparing the source system with the target system, that this data still needs to be written.) I have tried sorting the data beforehand and using single partition. Nothing has helped so far.
An Azure service that stores unstructured data in the cloud as blobs.
An Azure service for ingesting, preparing, and transforming data at scale.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
Hello @Anxhela Merko ,
Thanks for the question and using MS Q&A platform.
Thats kind of strange, the only think which stands out to me may be the Errors configuration . Can you please check on your end and see if that's set?
Himanshu Please accept as "Yes" if the answer provided is useful , so that you can help others in the community looking for remediation for similar issues.
Hi, thanks for your reply. Unfortunately adding an assert does not throw an error. I retrieve the data via an API and save it as JSON-files in my Blob Storage container. For every ID, I have a file. I was able to find out that the lines that are not being written come from a certain ID.
Now the file is retrieved and newly written to the blob container every day. The pipeline also runs everyday. Every time, the data flow simply ignores this specific ID and does not read the corresponding file. I have looked at the file and I cannot find anything wrong with it.
Any idea why the data flow would not read a file from the container, while it always reads the rest?
Hello @Anxhela Merko ,Can you please share ID ? I am assuming that the filename is like IDXXXXX.json and you are trying to read the file content and at this time all the files with the differnent ID are read fine with the exception of this one .