This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(233.6, 3%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EFJ%3C/text%3E%3C/svg%3E)
Currently, we integrated Azure data factory CDC, Our source system is the SQL server destination is the storage account.
we updated and deleted data in the source system. In both cases, it created files in a storage account but both the files look similar,
so how to differentiate which one is deleted and which one is updated? Even if opened both look similar. Please advise as to how to handle this
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(92.8, 25%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDG%3C/text%3E%3C/svg%3E)
Right now I'm having the same problem. Performing, INSERT or DELETE operations creates similar files on the blob storage so I can't know which operatios was performed on each row 🥲
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 4%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Hello @Franklin John ,
Welcome to the Microsoft Q&A and thank you for posting your questions here.
To understand your question, you would like to know how to differentiate which data is deleted and which data is updated in your ADF.
The cause is on your second screenshot. "The CDC is not running!"
When you enable native change data capture CDC or auto incremental extraction options in ADF mapping data flow, you will be able to identify the differences between the deleted and updated data.
Native change data capture is always recommended as the simplest way for you to get change data.
You can read more about change data capture in the following link.:
Change data capture in Azure Data Factory and Azure Synapse Analytics.
I hope this is helpful! Do not hesitate to let me know if you have any other questions.
Please remember to "Accept Answer" if answer helped, so that others in the community facing similar issues can easily find the solution.
Best Regards,
Sina Salam
Hi @Sina Salam
CDC was running properly. For taking a screenshot I stopped it.
The Url that you shared, We were using previously. Now we migrated to the Change data capture (preview) pipeline.
How to differentiate in this new preview technology?
Hi @Franklin John
Thank you for more explanations.
To differentiate deleted and updated data using Azure CDC preview, you can use the following methods:
NOTICE THE VALUE.
Also, you can use the below links for a suitable configuration:
NOTE: The above should be all you need, and I strongly believe it will work, except you are using unrelated database as mentioned.
I hope this helps you understand how to differentiate deleted and updated data using Azure CDC preview.
Best Regards,
Sina Salam
Hi @Sina Salam
We followed the same steps but the "__$operation" column is not Available in CDC preview mapping. But it's already available in Sql Database. ADF CDC preview shows only main columns not showing ____operation,____start_lsn,..etc columns. screenshot is attached
Hi @Sina Salam
Any update?