question

rajivgandhiveerabathiran-3463 avatar image
0 Votes"
rajivgandhiveerabathiran-3463 asked KranthiPakala-MSFT commented

How to handle delta load from sap bw openhub table to azure table

1.we want to load data from sap bw openhub to azure table through data factory .
2. how to get incremental or delta load from sap bw to azure

azure-data-factory
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Hello @rajivgandhiveerabathiran-3463,

Just checking in to see if the below answer was helpful. If it answers your query, do click Accept Answer and Up-Vote for the same. And, if you have any further query do let us know.

0 Votes 0 ·

1 Answer

KranthiPakala-MSFT avatar image
0 Votes"
KranthiPakala-MSFT answered KranthiPakala-MSFT edited

Hello @rajivgandhiveerabathiran-3463,

Thanks for the question and using MS Q&A platform.

The ADF SAP BW Open Hub Connector offers two optional properties: excludeLastRequest and baseRequestId (as shown in below image) which can be used to handle delta load from Open Hub.

  • excludeLastRequestId: Whether to exclude the records of the last request. Default value is true.

  • baseRequestId: The ID of request for delta loading. Once it is set, only data with requestId larger than the value of this property will be retrieved.

205578-image.png

For more detailed explanation about Delta extraction flow, please refer to this document: SAP BW OpenHub Delta extraction flow using Azure Data Factory
Below is the high level architecture diagram of the delta copy flow.

205671-image.png

You can also refer to this official MS documentation which has step by step implementation for incremental data copy from SAP BW using ADF : Incremental copy from SAP BW Open Hub

205599-image.png

You can also utilize the out of box template from ADF pipeline template gallery and update your sink to your desired data store:

205600-image.png

Hope this will help. Please let us know if any further queries.


  • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

  • Want a reminder to come back and check responses? Here is how to subscribe to a notification

  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators



image.png (29.0 KiB)
image.png (59.9 KiB)
image.png (34.4 KiB)
image.png (32.6 KiB)
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.