Add an SAP Datasphere source to an eventstream

The dedicated SAP Datasphere source creates an eventstream source and a Kafka endpoint for receiving replicated data from SAP Datasphere. You use the endpoint properties to configure an Apache Kafka connection and Replication Flow in SAP Datasphere.

This article shows you how to add the SAP Datasphere source, configure SAP Datasphere to send data, and verify the incoming events.

Prerequisites

Before you begin, make sure you have:

  • Access to a workspace assigned to a Fabric capacity or trial capacity.
  • Contributor or higher permissions in the workspace.
  • An SAP Datasphere account with Premium Outbound Integration enabled.
  • Access to an SAP Datasphere space and a supported source connection for the data that you want to replicate.

Add SAP Datasphere as a source

  1. In Fabric, open Real-Time hub.

  2. Select Add data under Streaming data.

  3. Search for SAP Datasphere.

  4. On the SAP Datasphere tile, select Connect.

    Screenshot of the Real-Time hub Add data page showing the Connect option for the SAP Datasphere source.

  5. On the Configure connection settings page, enter a name for the source.

  6. Under Stream details, select the workspace and enter a name for the eventstream. Then select Next.

    Screenshot of the SAP Datasphere Configure connection settings page showing the source name, workspace, eventstream name, and stream name.

  7. On the Review + connect page, confirm that the eventstream and source were created successfully. Select Open Eventstream.

    Screenshot of the SAP Datasphere Review and connect page showing successful eventstream and source creation and the Open Eventstream button.

Get the Kafka connection properties

The SAP Datasphere source provides a Kafka endpoint for SAP Datasphere Replication Flow. Retrieve its properties after you create the source.

  1. In the eventstream live view, select the SAP Datasphere source.

  2. In the Details pane, copy these values:

    • Kafka broker
    • Topic name
    • Kafka SASL password-primary or Kafka SASL password-secondary

  3. Note the displayed Security protocol and SASL mechanism. The connection uses SASL_SSL with the PLAIN mechanism.

    Screenshot of an SAP Datasphere source in an eventstream showing the Kafka broker, topic name, security protocol, and SASL password properties.

Keep these values available when you create the Apache Kafka connection in SAP Datasphere.

Create an Apache Kafka connection in SAP Datasphere

  1. In the connection management page of your SAP Datasphere space, create a connection.

  2. Select Apache Kafka as the connection type.

    Screenshot of the SAP Datasphere connection creation page with Apache Kafka selected.

  3. Configure these connection properties:

    Property Value
    Kafka Brokers Enter the Kafka broker value from the SAP Datasphere source in Eventstream.
    Authentication Type Select User Name And Password.
    Kafka SASL User Name Enter $ConnectionString.
    Kafka SASL Password Enter the primary or secondary Kafka SASL password from the SAP Datasphere source.
    Replication Flows Select Enable.

  4. Select Save.

    Screenshot of the SAP Datasphere Apache Kafka connection properties used for a Replication Flow.

Create a replication flow

Use the Apache Kafka connection as the target of an SAP Datasphere replication flow. For more information, see Create a Replication Flow in the SAP documentation.

  1. In SAP Datasphere, select Data Builder.

  2. Select New Replication Flow.

    Screenshot of the SAP Datasphere Data Builder page showing the option to create a Replication Flow.

  3. Select a source connection and source container, and then add the source objects to replicate.

    Screenshot of an SAP Datasphere Replication Flow showing the selected source connection, container, and source objects.

  4. For the target connection, select the Apache Kafka connection that you created.

    Screenshot of an SAP Datasphere Replication Flow with an Apache Kafka target connection selected.

  5. Change the target object name to the Topic name from the SAP Datasphere source in Eventstream.

    Screenshot of an SAP Datasphere Replication Flow showing the target object name configured with the Eventstream topic name.

    Important

    The target object name must match the Eventstream topic name. SAP Datasphere assigns the source object name by default, so change it before you deploy the flow.

  6. Make sure Delete All Before Loading isn't selected in the target object settings.

    Note

    The Eventstream Kafka endpoint doesn't allow SAP Datasphere to delete its topic. If you select Delete All Before Loading, target setup fails with an authorization error.

    Screenshot of SAP Datasphere target object settings showing the Delete All Before Loading option cleared.

Deploy and verify the replication flow

  1. In SAP Datasphere, deploy and activate the replication flow.

  2. Open the SAP Datasphere monitoring page and confirm that the flow is running without errors.

    Screenshot of the SAP Datasphere monitoring page showing the status of a Replication Flow.

  3. In Fabric, open the eventstream that contains the SAP Datasphere source.

  4. Select the default stream, and then verify that replicated events appear in the data preview.

    Screenshot of an active SAP Datasphere source with replicated sales records in the Eventstream data preview.

Related content

  • Last updated on