multiple sink transaction in Azure Data Factory

Question

multiple sink transaction in Azure Data Factory

44 0

hI, I have one dataflow and one pipeline. And there are two sinks in the dataflow. I want to do that if there are some error happened in the any dataflow, then these two dataflow all rollback.

Harishga 6,000 Reputation points Microsoft External Staff

2023-11-24T04:02:47.4033333+00:00

Hi 44
Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

1 answer

Your answer

Harishga 6,000 Reputation points Microsoft External Staff

2023-11-24T04:02:47.4033333+00:00

Hi 44
Just checking in to see if the below answer helped. If this answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Answer 1

Nandan Hegde 36,146 MVP Volunteer Moderator

Hey,

Unfortunately ADF doesnt support transaction or roll back aspect as an in built functionality.

You would have to write your own custom logics or flows to ensure the rollback aspects.

Like in case if your sinks are 2 different tables within the same Azure SQL database, you can copy both into 2 staging tables and then use an SP activity which would have transaction to load both into final tables.

For other sinks, you can initially preserve the initial state of the sinks in some location and in case of any failure, revert the sink back to original state via the copy preserved.

Harishga 6,000 Reputation points Microsoft External Staff

2023-11-23T05:03:15.6933333+00:00

Hi 44
Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

multiple sink transaction in Azure Data Factory

1 answer

Your answer