Source HTTP response is greater than 4 MB for copy activity

ssalun 26 Reputation points

Hi ,

I am working on a pipeline which contains copy activity to copy data from HTTP response to Azure SQL database.
I am getting the response and the activity is completed successfully but no rows written to the SQL server table.
After doing google search came to know about the limitations for HTTP payload which is 4 MB. The work around is batching or paging the response, I would like to seek your help on batching the copy activity. If anyone has faced similar issue could you please share your knowledge?


Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
7,180 questions
{count} votes