Azure Data factory V2 for each loop run twice in pipeline with couple of seconds delay

Mansing 1 Reputation point


We had one incident in our production environment of Azure data factory v2 instance, where for-each iterator loop run twice in one single run of pipeline with some couple of seconds delay.

In foreach loop iterator, we are doing some data load steps based on some criteria. Due to loop running twice, Data copy activities has duplicated data into target tables.

Please let me know, any details you need to investigate further.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,468 questions
{count} votes