Azure data factory: Duplicate values in with pagination

Ronald Mussche 36 Reputation points
2023-04-07T08:40:05.6866667+00:00

Hello, we do an API call where we use pagination rules: User's image

In the endpoint we see indeed that it works: User's image

But we have duplicate values random every time at row 2000 3000 and 7000. but this can change every call. but it is not on every step. If I do the calls in postman I don't get duplicate values. I have the idea that something is going wrong with merging. Hope someone can help me with this. Thanks in advanced. Ronald

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,639 questions
{count} vote

Accepted answer
  1. ShaikMaheer-MSFT 38,546 Reputation points Microsoft Employee Moderator
    2023-05-16T06:33:16.4833333+00:00

    Hi Ronald Mussche,

    Thank you for sharing your findings and resolution that, adding sort to the call helps. This helps community as well.


    Please consider hitting Accept Answer button. Accepted answers help community as well.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.