Azure Data Explorer Command activity response has 5001 rows, which exceeds the max limit of 5000 rows

jkj 1 Reputation point
2022-07-15T11:48:49.517+00:00

I'm trying to ingest data into ADX tables through Foreach/copy data activity in ADF..
and now I'm getting this error.

220998-image.png

what does this error mean and how can I solve it?

Thank you for any help in advance!

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
484 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,615 questions
{count} votes

1 answer

Sort by: Most helpful
  1. VinodKumar-0434 271 Reputation points
    2022-07-15T19:25:33.323+00:00

    Hi @jkj , By design lookup activity has a limitation of 5000 rows in the result set.

    Here is the reference

    control-flow-lookup-activity

    But you can use a work around as in the below link

    https://youtu.be/Y4yFXGbhYZI

    Please upvote if you find the answer useful. Thanks.