Share via

Auto rollback on Cosmos DB using ADF (Azure Data Factory)

Devashish Parmar (BLR GSS) 86 Reputation points
2022-11-09T04:16:09.247+00:00

I want to ask what will happen if I am using a ADF pipeline to load data to Cosmos DB and the pipeline fails in between. Will the partial transactions commit or rollback?

For example, there are 100 documents that I am loading using ADF pipeline and the job fails in between (for any reason) when it has already processed 60 documents. My question is will the 60 documents auto commit or will it rollback all the 60 documents.

If the answer is 'Auto commit' then how can I perform a auto rollback in case of failure.?

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,886 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,579 questions
Accepted answer
  1. Nandan Hegde 35,751 Reputation points MVP Volunteer Moderator
    2022-11-09T04:46:43.247+00:00

    Hey,
    Based on my understanding ADF doesnt have any sort of transactions for any sink aspects directly.
    you would have to create a custom method yourself

    https://stackoverflow.com/questions/55447997/how-to-handle-transaction-in-cosmosdb-all-or-nothing-concept

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.