Hey,
Note: There is a restriction of max 40 activities per pipeline in an ADF.
So whenever we design anything, we have to take that into consideration
Design pattern ADF

Alfonso
21
Reputation points
Do you know if it is better to perform an incremental load using parameters with Lookup & Foreach passing each source and target table one by one ? or on the contrary do you think it is better to create a Lookup and add Filter to copy each table in parallel ?
I have this doubt because there are more than 40 tables that I have to increment.
Thank you,
Best regards
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
Accepted answer
-
Nandan Hegde 36,146 Reputation points MVP Volunteer Moderator
2021-12-31T03:43:17.747+00:00