Share via

Azure Logic Apps: Is pagination limited to 3 pages only?

Anonymous
2023-05-02T08:27:42.62+00:00

Hello!

I'm trying to process an excel file containing roughly 500k rows of data and converting it into a csv. To do this, I've used ExcelConnector to get the content of the document and have used the Create CSV Table function in putting the data into a csv file. I've enabled pagination and have set the max items setting to 100k but after running the pipeline, 3 csv files were generated, each containing around 100k rows of data. So, more than 100k rows of data are missing.

Can the number of pages be configured? If yes, how to do it? And, am I missing a step here?

Thanks in advance for the response/ideas.

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,996 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. MayankBargali-MSFT 70,016 Reputation points
    2023-05-02T13:22:26.8233333+00:00

    @Anonymous Thanks for reaching out. Can you please confirm if you have set the Threshold value on the connector setting as this could be one of the reasons.

    User's image

    There are a few limitations of the connector but I don't see any that would cause this behavior.

    0 comments