How to handle delta load from sap bw openhub table to azure table

Question

1.we want to load data from sap bw openhub to azure table through data factory .
2. how to get incremental or delta load from sap bw to azure

Answer 1

Hello @rajivgandhi veerabathiran ,

Thanks for the question and using MS Q&A platform.

The ADF SAP BW Open Hub Connector offers two optional properties: excludeLastRequest and baseRequestId (as shown in below image) which can be used to handle delta load from Open Hub.

• excludeLastRequestId: Whether to exclude the records of the last request. Default value is true.
• baseRequestId: The ID of request for delta loading. Once it is set, only data with requestId larger than the value of this property will be retrieved.

For more detailed explanation about Delta extraction flow, please refer to this document: SAP BW OpenHub Delta extraction flow using Azure Data Factory
Below is the high level architecture diagram of the delta copy flow.

You can also refer to this official MS documentation which has step by step implementation for incremental data copy from SAP BW using ADF : Incremental copy from SAP BW Open Hub

You can also utilize the out of box template from ADF pipeline template gallery and update your sink to your desired data store:

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators