Kusto: I am trying to read 23594558+ records getting OutOfMemoryException error.

VS 6 Reputation points Microsoft Employee
2022-11-02T07:03:15.853+00:00

Try to copy data from Kusto to ADLSGen2 lake

getting "OutOfMemoryException"

Kusto Query:
set notruncation;
set truncationmaxsize=459000000;
Customer_Subscription
| distinct Id

Please let me know the if you know any solution/workaround

Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
480 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. mckreddy 0 Reputation points Microsoft Employee
    2023-02-09T06:51:51.9266667+00:00

    Use the following commands before your command.

    set maxmemoryconsumptionperiterator=68719476736000;

    set notruncation;

    The best way to export data from Azure Data Explorer to ADLS GEN2 is using ADF Copy activity.

    0 comments