ADF-SAP Table connector Memory Error for SAP ECC Source

Tyagi, Amit 5 Reputation points
2023-03-25T12:58:11.03+00:00

Hello,

I am trying to retrieve the data from SAP ECC-ERP 6.0 on Netweaver 7.5 using ADF-SAP Table connector, I can access the SAP tables using Preview Data option, however while trying to ingest the data to ADLS getting the below error:

Could you please assist me to with some resolution as its very urgent to extract the data from SAP and load into ADLS.

Failure happened on 'Source' side. ErrorCode=SapRfcClientOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=SapRfcClient operation '/SAPDS/RFC_READ_TABLE2' failed. Please contact SAP support if you need further help. Error message: 'No more memory available to add rows to an internal table.',Source=Microsoft.DataTransfer.Runtime.SapRfcHelper,''Type=SAP.Middleware.Connector.RfcAbapRuntimeException,Message=No more memory available to add rows to an internal table.,Source=sapnco,'

Awaiting your reply and thanks in advance.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,700 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Erkan Sahin 830 Reputation points
    2023-03-25T13:34:17.34+00:00

    The error message indicates that the SAP table connector is running out of memory while trying to retrieve data from the SAP table. This could be caused by a few different reasons:

    1. The SAP table contains a large amount of data that exceeds the available memory on the SAP server or the ADF server.
    2. The SAP server or ADF server does not have enough memory allocated for the SAP table connector.
    3. There could be issues with the SAP table connector itself, such as a memory leak or a bug that is causing it to consume too much memory.

    To resolve this issue, you can try the following steps:

    1. Check if the SAP table contains a large amount of data. If this is the case, you may need to filter the data before ingesting it into ADLS, or consider using a different method for extracting data from SAP, such as SAP BW or SAP HANA.
    2. Increase the memory allocation for the SAP table connector or the ADF server. You can do this by adjusting the settings in the SAP table connector or in the ADF cluster configuration.
    3. Check if there are any known issues with the SAP table connector and see if there are any patches or updates available to resolve them.
    4. If none of the above steps work, you may need to contact SAP support for further assistance. They may be able to provide more information on the cause of the error and help you resolve it.

    Please mark my answer if it helps you :-)


  2. AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee
    2023-04-06T11:07:17.1133333+00:00

    @Tyagi, Amit , Regarding the partitioning issue, you could try set partitioning option in derived column transformation. However, ADF will decide the partitioning at runtime based on the provided column. User's image

    Regarding the memory issue at the SAP server side, You may need to consult with SAP administrator to determine whether this is a viable option. Hope it helps. Kindly accept the answer as accepted answer helps community.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.