Microsoft Graph API Result Size Limit

Question

Hi, I have created a pipeline in Azure data factory which needs to extract all Active Directory groups from Microsoft Graph API. For this purpose I use the GET https://graph.microsoft.com/v1.0/groups query but it returns me only 100 records. Is there any parameter I can use to the query to return all the records (which are approximately 5000 records) ? Thanks a lot.

Answer 1

Yes, this is fully discussed in the documentation for paging results here. Each request sends you the URL to the next set of results. You have to extract that value and keep calling the results until everything is read in. If you're able to use the Graph SDK then it can handle this for you automatically.

Answer 2

Hi Taylor, I edited the pagination rules in Azure Data Factory as shown in the screenshot and managed to collect all the data.

Thank you.