How to get count of upsert action in dataflow for workspace db source and sink

heta desai 252 Reputation points
2022-08-08T18:53:00.443+00:00

I have created a dataflow where source is workspace DB and sink is also workspace DB. I am trying to perform UPSERT and I need to get count of insert and update performed on sink.

Please suggest me how do I create dataflow for the same.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,862 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,568 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HimanshuSinha-msft 19,471 Reputation points Microsoft Employee
    2022-08-09T22:03:05.563+00:00

    Hello @Anonymous ,
    Thanks for the question and using MS Q&A platform.
    As we understand the ask here is to find the row count for UPSERT in data flow , please do let us know if its not accurate.
    We have the pipeline and inside that we create a dataflow . When the dataflow gets executed the output on the pipeline level is a output object which has many attributes .
    I think you should be able pull the data what you are looking for from here . In my exampleI used the below dynamic expression .

    229732-image.png

    @ hide (activity('Data flow1').output.runStatus.metrics.sink1.rowsWritten)

    229570-image.png

    Please do let me if you have any queries.
    Thanks
    Himanshu


    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
      • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.