Add Amazon Kinesis Data Streams as source in Real-Time hub (preview)

This article describes how to add Amazon Kinesis Data Streams as an event source in Fabric Real-Time hub.

Note

Real-Time hub is currently in preview.

Prerequisites

  • Get access to the Fabric premium workspace with Contributor or above permissions.
  • An Amazon Web Services (AWS) account with the Kinesis Data Streams service enabled.

Launch Get events experience

  1. Switch to the Real-Time Intelligence experience in Microsoft Fabric. Select Microsoft Fabric on the left navigation bar, and select Real-Time Intelligence.

    Screenshot that shows how to switch to the Real-Time Intelligence experience.

  2. Select Real-Time hub on the left navigation bar.

    Screenshot that shows how to launch Real-Time hub In Microsoft Fabric.

  3. On the Real-Time hub page, select + Get events in the top-right corner of the page.

    Screenshot that shows the selection of Get events button in Real-Time hub.

Add Amazon Kiness Data Streams as a source

  1. On the Select a data source screen, select Kinesis Data Streams.

    A screenshot of selecting Kinesis Data Streams.

  2. On the Connect screen, to create a connection, select New connection.

    Screenshot that shows the Connect page with the New connection highlighted.

  3. In the Connection settings section, for Data Stream name, enter the data stream name from Amazon Kinesis.

    A screenshot of the Amazon Kinesis data stream screen.

  4. In the Connection credentials section, do these steps.

    1. For Connection name, enter a name for this cloud connection.

    2. For Authentication kind, confirm that Kinesis key is selected.

    3. For API Key and API Secret, enter the credentials you use to access your Kinesis Data Stream. Go to the Amazon IAM console and select Security credentials. Copy an Access Key ID from the Access keys screen and paste it into API Key and API Secret.

      A screenshot of how to access the AWS Kinesis security credentials.

    4. Select Connect.

      A screenshot of the Connect screen.

  5. Now, on the Connect page, for Source name, enter a source name for this new eventstream source.

  6. Scroll down, and under Configure Amazon Kinesis data source, enter a Region for the data source. You can find the Amazon region code such as us-west-2 from the Kinesis Data stream summary.

    A screenshot of the Region field for Configure Amazon Kinesis data source.

  7. In the Stream details section of the right pane, do these steps:

    1. Select the workspace where you want to save the connection.
    2. Enter a name for the eventstream to be created for you.
    3. Name of the stream for Real-Time hub is automatically generated for you.
  8. Select Next.

  9. On the Review and create screen, review the summary, and then select Create source.

View data stream details

  1. On the Review and create page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Confluent Cloud Kafka source. To close the wizard, select Close at the bottom of the page.
  2. In Real-Time hub, switch to the Data streams tab of Real-Time hub. Refresh the page. You should see the data stream created for you. For detailed steps, see View details of data streams in Fabric Real-Time hub.

To learn about consuming data streams, see the following articles: