Design pattern ADF

Alfonso 21 Reputation points
2021-12-30T20:06:06.877+00:00

Do you know if it is better to perform an incremental load using parameters with Lookup & Foreach passing each source and target table one by one ? or on the contrary do you think it is better to create a Lookup and add Filter to copy each table in parallel ?

I have this doubt because there are more than 40 tables that I have to increment.

Thank you,
Best regards161541-captura.jpg161486-captura1.jpg

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,623 questions
{count} votes

Accepted answer
  1. Nandan Hegde 36,146 Reputation points MVP Volunteer Moderator
    2021-12-31T03:43:17.747+00:00

    Hey,
    Note: There is a restriction of max 40 activities per pipeline in an ADF.
    So whenever we design anything, we have to take that into consideration


0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.