nested loop in adf

Question

Hi,

what happened in ADF engineer when nested loop is applied which are the cases its required apart getmetadata and count of files and all

Answer 1

The concept of nested loops remains the same whether be in coding world or in ADF as below aspect :

https://www.programiz.com/cpp-programming/nested-loops

in ADF/Synapse, below are some of the examples:

1. Power BI <> ADF integration

Assume I need to get last refresh status of all reports within my workspace

a) the 1st loop would get me the list of all reports within the workspace

b) the inner loop would iterate through this list and get individual reports details

the above concept can be used for other aspects like get list of all ADF pipelines and get status of the individual pipelines etc.

2. meta data driven pipelines

Assume you have a common logic of syncing data (multiple tables) from 1 database into another

and you have created a pipeline for the same.

And you want to do that synchronization for multiple databases, so you would need a nested logic; 1st get list of all databases and looping through it and then syncing/looping all tables from the individual databases