Logic app pulling SQL Sever data with on premise data gateway - response limits

Question

Hello,

I'm looking into using the on premise data gateway to pull data from an on prem SQL server for use with Logic apps. I was reviewing some documentation (https://learn.microsoft.com/en-us/data-integration/gateway/service-gateway-onprem#considerations) and one of the considerations is that there is a 8 MB compressed limit for responses.

I'm looking to send a query to the SQL server to get back a certain set of records back. Does this limit mean that the response from the SQL server must be 8MB or less? If my data ends up being over 8MB will I need to send multiple queries in order to work around this limit?

Thanks,

Mike

Answer 1

Hi @Anonymous

Welcome to Microsoft Q&A! Thanks for posting the question.

Unfortunately, it is the limitation of OPDG that the Read operations have a 2-MB request limit and an 8-MB compressed data response limit as mentioned here.
Yes, you can have your own logic that will send multiple requests/different queries from the logic app as the workaround.

Alternatively, you can save the results of the query in blob storage and share a link to the file in the response. For this, you need to write your own service that will be running on your on-premise that will store the result to the storage account based on your input. But if there is no other outbound activity allowed from your on-premise network or you don't want to write your own service, then this would not be feasible for your scenario.

I will also suggest you to review the known issue and limitation for SQL server connector.