How can I copy data from a MySQL server to a dedicated SQLPool without duplicates in Azure Synapse?

Federico Arturo Ramirez Seidel 26 Reputation points
2022-05-16T18:54:23.05+00:00

Hello, so I hace a database in a MySQL server, I am using the ingest tool in synapse and I want this to be done every week, but if I run the pipeline the tool created twice, it duplicates my data.
Is there a way this doesn't happen?

Thanks!

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,396 questions
0 comments
Accepted answer
  1. GeethaThatipatri-MSFT 27,642 Reputation points Microsoft Employee
    2022-05-17T14:58:21.15+00:00

    Hi, @Federico Arturo Ramirez Seidel Welcome to the Microsoft Q&A forum, and thanks for reaching out.
    As we understand the ask here is you want to know how to copy data from MySQL to dedicated sqlpool without duplicates.

    You can copy data using synapse where you can refer to this document however for duplicates you can use debezium connector for CDC data with Azure DB for MySQL which can help you in the scenario. Steps are shared in the blog here

    Hope this document helps.
    Please let me know if you need any additional information.

    Regards
    Geetha

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest