More than two time trigger duplicate records inserted in increment load.

Question

Hi Team,

I am follow below link create Pipeline i have haapy answer but I have problem when i am insert more two time for day its dupplicate records inserted.
please anybody help how to avoid duplicate record in sink table

my client didnt accept this aproach beacuse sometime tirgger fail or user can trigger two time duplicate records inserted how to avoid this.
https://learn.microsoft.com/en-us/answers/questions/144566/increament-load-based-on-my-status-column.html

Answer 1

Hello @Shanvitha ,

Thanks for the ask , i think you can make a small change on the reference pipeline . You need to switch from Update/Insert to Upsert . Please see the snaphot below .

Thanks Himanshu

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.