User Configuration Issue with Lookup Activity in ADF

Haritha MADDERI 21 Reputation points
2022-06-22T06:21:18.543+00:00

We have requirement to load 2 Million records Using SQL Query with Lookup activity in pipeline, But it was throwing error like The size 4194461 of lookup activity result exceeds the limitation 4194304, Could any one Please help on this
213598-microsoftteams-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,252 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Nandan Hegde 34,171 Reputation points MVP
    2022-06-22T06:25:05.467+00:00

    Hey,
    There is a limitation of lookup activity but my ask is why are you using lookup activity ?
    you should use the copy activity with source as SQL and query there:

    213579-image.png


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.