Azure Synapse Creating random duplicate data while inserting from staging to final table

Monika Patel 0 Reputation points

I have simple task at hand. I have close to 200 unique million records seating in a staging table on Azure Synapse. The task is to run an insert statement to insert data into final table. Sounds simple, but here is the problem I am running into for which I am scratching my head. Every time I execute insert random rows are duplicated in final table. I have checked multiple times that staging table has all unique values based on combination of composite key of 3 columns.

Has anyone ran into this weird issue before? Any help would be highly appreciated.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,826 questions
{count} votes