data factory - delta sink

Question

hello
I am using the delta sink in the data flow of data factory.

in the settings tab of the delta sink, the key columns are column1 and column2 in the list of columns

what does this mean?

Does this mean that for every load, the system is looking to see which of the other columns have changed for this key (column1 and column2) ?

for example:

load1

---

column1-x

column2-y

...

column 5 - testvalue

load2

---

column1-x

column2-y

...

column 5 - checkvalue

as per above example, does it mean that the column 5 will be updated for key columns of x,y ?

Thank you

Answer 1

Hi @arkiboys

Yes, your understanding is correct. For the mentioned key columns, updation will happen on other columns.

Here is a wonderful demo by Mark kromer about delta files and it's capabilities. Please do check.

https://youtu.be/evqQRwsF_Ps

Kindly revert incase you have any other question.