How to implement an incremental data load using ADF from a REST API Source

Question

Hello,

I am working on developing a data Warehouse in Azure. I am ingesting data from Dynamics 365 and Business Central. As for Business Central, I used the REST API connector and implemented full data load from Business central to Azure SQL DB, and now I would like to update my tables when there is new data. I have read the documentations about how to implement incremental data load from SQL tables. Is the same concept applicable to REST APIs or there is another way of doing it.

Answer 1

Hi @Osama Ahmed , similar use-case has been discussed below, please go through it.

https://learn.microsoft.com/en-us/answers/questions/500038/incremental-data-ingestion-approach-for-rest-api-a.html

https://learn.microsoft.com/en-us/answers/questions/809376/does-adf-support-incremental-load-from-rest-api-to.html Thanks