question

FedericoArturoRamirezSeidel-6534 avatar image
0 Votes"
FedericoArturoRamirezSeidel-6534 asked FedericoArturoRamirezSeidel-6534 commented

How can I copy data from a MySQL server to a dedicated SQLPool without duplicates in Azure Synapse?

Hello, so I hace a database in a MySQL server, I am using the ingest tool in synapse and I want this to be done every week, but if I run the pipeline the tool created twice, it duplicates my data.
Is there a way this doesn't happen?

Thanks!

azure-sql-databaseazure-synapse-analytics
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

GeethaThatipatri-MSFT avatar image
0 Votes"
GeethaThatipatri-MSFT answered FedericoArturoRamirezSeidel-6534 commented

Hi, @FedericoArturoRamirezSeidel-6534 Welcome to the Microsoft Q&A forum, and thanks for reaching out.
As we understand the ask here is you want to know how to copy data from MySQL to dedicated sqlpool without duplicates.

You can copy data using synapse where you can refer to this document however for duplicates you can use debezium connector for CDC data with Azure DB for MySQL which can help you in the scenario. Steps are shared in the blog here

Hope this document helps.
Please let me know if you need any additional information.

Regards
Geetha

· 3
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hi, @FedericoArturoRamirezSeidel-6534 We haven't heard back from you. Just wanted to check please let me know if you find the above reply useful. If yes, do click on the 'Mark as answer' link in the above reply. This will help other community members facing similar queries to refer to this solution.

Regards
Geetha

0 Votes 0 ·

Hi, @FedericoArturoRamirezSeidel-6534 Did you get a chance to check my above reply?

Regards
Geetha

0 Votes 0 ·

Hello! I worked it out, I just used a script to truncate the tables before copying them.

Thanks!

0 Votes 0 ·