Auto rollback on Cosmos DB using ADF (Azure Data Factory)

Devashish Parmar (BLR GSS) 86 Reputation points
2022-11-09T04:16:09.247+00:00

I want to ask what will happen if I am using a ADF pipeline to load data to Cosmos DB and the pipeline fails in between. Will the partial transactions commit or rollback?

For example, there are 100 documents that I am loading using ADF pipeline and the job fails in between (for any reason) when it has already processed 60 documents. My question is will the 60 documents auto commit or will it rollback all the 60 documents.

If the answer is 'Auto commit' then how can I perform a auto rollback in case of failure.?

Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,535 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,129 questions
{count} votes

Accepted answer
  1. Nandan Hegde 31,346 Reputation points MVP
    2022-11-09T04:46:43.247+00:00

    Hey,
    Based on my understanding ADF doesnt have any sort of transactions for any sink aspects directly.
    you would have to create a custom method yourself

    https://stackoverflow.com/questions/55447997/how-to-handle-transaction-in-cosmosdb-all-or-nothing-concept


0 additional answers

Sort by: Most helpful