insert update logic

Question

insert update logic

Vineet S 1,390

Hi,

how to add insert and update logic in adf pipeline ... i am new to it so it would be great to update with some screenshots

i am using copy activity now to insert full load for the first time

Vineet S 1,390 Reputation points

2024-07-12T03:11:12.76+00:00

And how can I add column last updated date
Vineet S 1,390 Reputation points

2024-07-12T03:11:24.6633333+00:00

And how can I add column last updated date
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2024-07-15T18:26:40.7266667+00:00

Do you want to perform an upsert based on the last updated date column?

Upserts work based on the "Key column."

Please refer to this tutorial on how upsert work.

If you have any further questions, please let me know.

1 answer

Your answer

Vineet S 1,390 Reputation points

2024-07-12T03:11:12.76+00:00

And how can I add column last updated date
Vineet S 1,390 Reputation points

2024-07-12T03:11:24.6633333+00:00

And how can I add column last updated date
Bhargava-MSFT 31,351 Reputation points Microsoft Employee Moderator

2024-07-15T18:26:40.7266667+00:00

Do you want to perform an upsert based on the last updated date column?

Upserts work based on the "Key column."

Please refer to this tutorial on how upsert work.

If you have any further questions, please let me know.

Answer 1

Hello Vineet S,

What is your sink in ADF?

if you are using Azure SQL as your sink in your copy actity, the you can use the "Upsert" write behavior in the "Copy Data" activity. The "Upsert" feature allows you to insert new rows into a target table and update existing rows based on a matching condition.

Using the Copy activity in adf for full load is a common approach when you're loading data for the first time. However, for subsequent loads, you might want to consider using incremental loads to insert or update data based on changes since the last load using the dataflow.

I hope this helps. User's image

Share via

insert update logic

1 answer

Your answer