Using Upsert/Alter row condition in azure data flow is not inserted all the records into the sink table

Question

1. Create a derived column "Flag" and updated with 'Y' or 'N'
2. Created Filter records with expression Flag='N'
3. Create Alter with upsert if "true()"
4. In Sink setting selected upsert

After running the pipeline expected was 30 which was showing in debug also but only 28 records are inserted into sink table with 2 records lost

Answer 1

Hello @SrikanthK ,

Welcome to the MS Q&A platform.

Please correct me if my understanding is wrong. You could see 30 records on the sink data preview, but only 28 records were inserted in your sink table.

Do you see all 30+ symbols on the left side in the sink data preview? If you see any '-', that means, the records will be deleted. (If you see 28 +, and 2- meaning, only 28 records will be inserted)

Can you please check if there is any 'delete if' in your alterrow transformation?

Answer 2

I see 30 + symbols only , will check again