How to specify the pagination rule ADF

Akhil 21 Reputation points
2022-06-09T12:05:06.683+00:00

How to specify the pagination rule for microsoft graph in ADF so that when it reaches the last page in the api extraction it would stop.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,334 questions
0 comments No comments
{count} votes

Accepted answer
  1. ShaikMaheer-MSFT 37,561 Reputation points Microsoft Employee
    2022-06-13T10:12:43.34+00:00

    Hi @Akhil ,

    Thank you for posting query in Microsoft Q&A Platform.

    Complete pagination details along with multiple examples are documented in below documentation link. Kindly check it.
    https://learn.microsoft.com/en-us/azure/data-factory/connector-rest?tabs=data-factory#pagination-support

    In above documentation kindly check below example, especially where end conditions explained in detail.
    https://learn.microsoft.com/en-us/azure/data-factory/connector-rest?tabs=data-factory#example-4variables-are-in-absoluteurlqueryparametersheaders-the-end-variable-is-not-pre-defined-and-the-end-condition-is-based-on-the-response

    Hope this helps. Please let us know how it goes.

    ------------

    Please consider hitting Accept Answer button. Accepted answers help community as well.


2 additional answers

Sort by: Most helpful
  1. Suba Balaji 11,186 Reputation points
    2022-06-12T06:26:42.247+00:00

    Hi @Akhil ,

    thanks for posting your question on MS Q&A platform.

    There has been a similar ask in the forum, please check this link and see if it helps.

    Thanks.

    0 comments No comments

  2. Anonymous
    2022-06-22T17:18:00.477+00:00

    If you are trying to extract large amount of data from Microsoft Graph, you should consider leveraging Microsoft Graph Data Connect instead of making calls to the REST APIs, which will be subject to throttling.

    https://learn.microsoft.com/en-us/graph/data-connect-concept-overview

    0 comments No comments