How to pass count of number rows affected in dataflow sink to piepleine

Question

I have created one dataflow where source is Azure SQL and sink is inline database Delta table. I want to get number of rows inserted in sink and pass those counts to pipeline and assign it to variable.

Answer 1

https://learn.microsoft.com/en-us/azure/data-factory/control-flow-execute-data-flow-activity

Answer 2

Hi @Anonymous ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question.

As I understand your ask, you want to get the count of rows written while using dataflow to copy data from Az SQL to Delta sink. Kindly let me know if my understanding is incorrect.

The above mentioned solution will work for all other sink dataset but for delta target, this capability is still not there. You would get 0 as the count in all scenarios. It is a known limitation when you use Delta as the sink.

For more details, kindly go through the official documentation: Known limitation of Delta format in Azure data factory

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators