Alternative way of Foreach loop in ADF

Question

Hello,

I have 70K records with distinct id, I have to loop for distinct id and based on that copy the data from API to Database.
I can achieve this by For each loop, but i wont think so its ideal to run for each loop for this many times.

Could you please suggest some alternative and efficient way to achieve the same, which will be really helpful.

Answer 1

Hello @Poddar, Ankur

There's Until Activity in ADF wherein you can set an expression which evaluates to True or False, based on the result of expression, it will loop

This is similar to do-until loop: https://learn.microsoft.com/en-us/azure/data-factory/control-flow-until-activity

But in your case, you can also create a Custom Activity by writing a custom code to loop and it can also poll the API

https://learn.microsoft.com/en-us/azure/data-factory/transform-data-using-custom-activity