Does Copy activity failure, rollback entire dataset?

Question

Copying huge dataset with Copy activity with 'Skip incompatible rows' and logging enabled to capture failed rows and mark them retry during next run. When I Encountered Transport/Remote host closed connection error, it did not write any row specific details to logs. The question is when such a failure happens, does it rollback entire dataset?

Answer 1

@Bala Thanks for using Microsoft Q&A !!

Unfortunately, Azure Data Factory does not have any in built transactions logic to rollback the entire data set. You need to create custom logic to achieve the same. You can refer to these two threads for your reference and implementation purpose -

• https://learn.microsoft.com/en-us/answers/questions/31313/transactions-in-adf.html
• https://social.msdn.microsoft.com/Forums/azure/en-US/7983f6b0-d945-41b7-82c7-a73191b85e55/rollback-failed-pipeline-to-avoid-partial-commit?forum=AzureDataFactory

Please let me know if you have any other questions.

----------

Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.