Hey, You can copy the entire data in a staging table and then leverage Stored proceudre to do the rest of copying only new data into the final table
how to avoid duplicated record in sql server when use Synapse copy data from blob to dedicated SQL pool scheduled
Te Liu
1
Reputation point Microsoft Employee
I want to copy data from blob in account storage to SQL server regularly every day. But I want to skip record if this record is already exist in table. thanks :)
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,366 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,613 questions
1 answer
Sort by: Most helpful
-
Nandan Hegde 36,066 Reputation points MVP Volunteer Moderator
2022-11-08T09:37:39.297+00:00