What is Continuation token and how can we get 2 lakh records in one opeartion in powershell

Question

Hi Team,

I want to get the size of each container and folders in all containers recursively for ADLS Storage account .. so i have prepared script for it .. when i run the script it doesnt give the full results and getting the warning message " all results are not fetched use this Continuation Token ".

I have lakhs of records i want to get result for all of them..

Continuation token is it like access key and if so where can i find that ?

Please let me know how can i use continuation token in script what is the upper limit of retrieved results..

Script is attached please check it.

46100-container-size.txt

Regards,
Jezz

Answer 1

Hello @jessy and welcome to Microsoft Q&A.

Sometimes the results are larger than is practical to send in one go. In these cases the results are batched or paginated. The results are broken up into pieces, and the continuation token is used to track where you are in getting the results.

Think of a bookmark in a book. The book is the results of your query, and each page in the book is a portion of the results. The continuation token is the bookmark used to keep track of which page is next to read.

For example on how to use the continuation token, please see:
https://learn.microsoft.com/en-us/powershell/module/az.storage/get-azdatalakegen2childitem?view=azps-5.2.0#example-3--list-items-recursively-from-a-filesystem-in-multiple-batches