zendesk pagination rules and multiple pages using adls gen2

Question

zendesk pagination rules and multiple pages using adls gen2

Ahsan 20

I am trying to implement pagination on my copy activity. I have 11,000 rows of data and my sink dataset is adls gen2 with format type: parquet. Currently, my pagination rules are: absoluteurl, body: next_page with maxrequestnumber = 10, which will give me 1000 records. this is because I get an error on page 11, so I paginate using date after ten pages.

I have done this exact method writing to Microsoft SQL server and got all 11,000 records to show up, however when I view my data in synapse analytics, I can only see 1000. When I paginate through the next 10 pages, it just replaces the previous records inserted. Is there a way to see all the records or another way to paginate for synapse analytics?

Amira Bedhiafi 41,131 Reputation points Volunteer Moderator

2023-10-18T20:38:12.86+00:00

Have you checked this link : https://learn.microsoft.com/en-us/answers/questions/1168150/zendesk-rest-api-pagination-rules-in-data-flow-in ?
KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2023-10-20T22:43:44.89+00:00

@Ahsan We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you

1 answer

Your answer

Amira Bedhiafi 41,131 Reputation points Volunteer Moderator

2023-10-18T20:38:12.86+00:00

Have you checked this link : https://learn.microsoft.com/en-us/answers/questions/1168150/zendesk-rest-api-pagination-rules-in-data-flow-in ?
KranthiPakala-MSFT 46,822 Reputation points Microsoft Employee Moderator

2023-10-20T22:43:44.89+00:00

@Ahsan We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you

Answer 1

@Ahsan Welcome to Microsoft Q&A forum and thanks for reaching out here.

As share by @Amira Bedhiafi and as per my past research on Zendesk API, you can use mapping data flow to implementation pagination.

User's image

I hope my other post by Amira will help you to get started on your requirement. But if you ever notice any issues, please feel free to open a new thread with details information about the issue and we will be happy to assist you.

Thank you

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Share via

zendesk pagination rules and multiple pages using adls gen2

1 answer

Your answer