@MartinJaffer-MSFT - i tried RFC 5988 also, did not work and it threw error. I solved the issue by creating a pyspark notebook to do looping of the pages. Don't think Azure have a mechanism to support these kind of scenarios.
Pagination of REST API call with "Link" in Header and rel="next"
Kumar, Arun
336
Reputation points
Hello,
I have a hard time doing pagination in ADF dataflow activity. Tried many of the below, nothing worked. My Link in Header is like below -
Any idea how to work on it?