rowsWritten from data flow is always 0

Question

I tried to get rowsWritten from data flow output log (with @activity('dataflowActivity').output.runStatus.metrics.sink1.rowsWritten.) , however it always show 0, the other number in the log looks good..

Answer 1

Hi @Anonymous ,

Thank you for sharing details on requested clarifications.

When writing to a delta sink, there is a known limitation where the numbers of rows written won't be return in the monitoring output.

Kindly check below documentation for same(especially Known limitations section)
https://learn.microsoft.com/en-us/azure/data-factory/format-delta

Hope this will help.

--------------------------------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications.

Answer 2

Hi @Anonymous ,

Thank you for posting query in Microsoft Q&A Platform.
I ran a sample dataflow activity on source file with data of 2 rows. I could see "rowsWritten" property capturing number of rows copied correctly.
Also, below microsoft documention says "rowsWritten" property tells you number of rows actually copied to sink.
https://learn.microsoft.com/en-us/azure/data-factory/control-flow-execute-data-flow-activity#monitoring-the-data-flow-activity

Could you please re-check your execution once. May be try to delete all rows from Sink table and then execute Data flow to examine how many rows actually copied to Sink table and also what is value the value in "rowsWritten" property of data flow output json.

Hope this will help. Please let us know for any queries. Thank you.

------------------

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a email-notifications.