SharePoint Online - List View Threshold Limit

Question

I am encountering problems with a SharePoint CSOM query.

I am using paging in a query agains a large SharePoint online list.

Here is my code:

Uri uri = new Uri(web.Context.Url);
string baseUrl = uri.GetLeftPart(UriPartial.Authority);
CamlQuery query = new CamlQuery();
query.ViewXml = "<View Scope='RecursiveAll'><RowLimit Paged='TRUE'>" + _rowLimit.ToString() + "</RowLimit><ViewFields><FieldRef Name="FileRef" /></ViewFields><Query><Where><Geq><FieldRef Name='Modified'/><Value Type='DateTime'>" + changeDate.ToString("yyyy-MM-ddTHH:mm:ssZ") + "</Value></Geq></Where></Query></View>";
do
{
  // Get the files matching the query
  ListItemCollection items = list.GetItems(query);
  web.Context.Load(items);
  web.Context.ExecuteQuery();
  Console.WriteLine($"Found {items.Count} files that may contain macros in document library");
  // Output the results
  foreach (ListItem item in items)
  {
  allFiles.AppendLine(baseUrl + location); }
  //Reset the current pagination info
  query.ListItemCollectionPosition = items.ListItemCollectionPosition;
} while (query.ListItemCollectionPosition != null);

SharePoint online always return a problem with the threashold!

If I skip the query, then everything is OK, but I need to filter the files by myself.

Is this bug known or did I miss something?

Answer 1

We are unable to fetch list items more than threshold limit. For example: you have 10,000 items, there are 3000 item which meets your caml expression.

At first you need to fetch all the items 10,000 and keep it in collection object, then query this collection object using Linq expression.

Please refer to below codes:

var web = clientContext.Web;
            var list = web.Lists.GetByTitle("listName");
            clientContext.Load(list);
            clientContext.ExecuteQuery();
            CamlQuery camlQuery = new CamlQuery();
            camlQuery.ViewXml = "<View Scope='RecursiveAll'><RowLimit>5000</RowLimit></View>";
            List<ListItem> items = new List<ListItem>();
            do
            {
                ListItemCollection listItemCollection = list.GetItems(camlQuery);
                clientContext.Load(listItemCollection);
                clientContext.ExecuteQuery();
                //Adding the current set of ListItems in our single buffer
                items.AddRange(listItemCollection);
                //Reset the current pagination info
                camlQuery.ListItemCollectionPosition = listItemCollection.ListItemCollectionPosition;
            } while (camlQuery.ListItemCollectionPosition != null);
			
            var filteritems = items.Where(tt =>(tt.FieldValues["Column_A"] != null) &&
            (tt.FieldValues["Column_B"] != null) &&
            (tt.FieldValues["Column_C"] == "") 
           );

---

If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.