data factory - delta sink

arkiboys 9,426 Reputation points
2023-02-03T10:18:45.9066667+00:00

hello
I am using the delta sink in the data flow of data factory.

in the settings tab of the delta sink, the key columns are column1 and column2 in the list of columns

what does this mean?

Does this mean that for every load, the system is looking to see which of the other columns have changed for this key (column1 and column2) ?

for example:

load1


column1-x

column2-y

...

column 5 - testvalue

load2


column1-x

column2-y

...

column 5 - checkvalue

as per above example, does it mean that the column 5 will be updated for key columns of x,y ?

Thank you

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,154 questions
{count} votes

Accepted answer
  1. Suba Balaji 10,936 Reputation points
    2023-02-04T15:00:56.2333333+00:00

    Hi @arkiboys

    Yes, your understanding is correct. For the mentioned key columns, updation will happen on other columns.

    Here is a wonderful demo by Mark kromer about delta files and it's capabilities. Please do check.

    https://youtu.be/evqQRwsF_Ps

    Kindly revert incase you have any other question.

    2 people found this answer helpful.

0 additional answers

Sort by: Most helpful