Add Azure Event Hubs source to an eventstream

Article
05/21/2024

This article shows you how to add an Azure Event Hubs source to an eventstream.

Note

If you want to use enhanced capabilities that are in preview, select Enhanced Capabilities at the top. Otherwise, select Standard Capabilities. For information about enhanced capabilities that are in preview, see Introduction to Fabric event streams.

Prerequisites

Before you start, you must complete the following prerequisites:

Get access to a premium workspace with Contributor or above permissions where your eventstream is located.
You need to have appropriate permission to get event hub's access keys. The event hub must be publicly accessible and not behind a firewall or secured in a virtual network.

Important

Enhanced capabilities of Fabric event streams are currently in preview.

Note

The maximum number of sources and destinations for one eventstream is 11.

Add Azure Event Hubs as a source

If you have an Azure event hub created with streaming data, follow these steps to add an Azure event hub as your eventstream source:

Create an eventstream with enhanced capabilities.
If you haven't added any source to your eventstream yet, select Add external source on the Get started page.

If you're adding an Azure event hub as a source to an already published eventstream, switch to Edit mode, select Add source on the ribbon, and then select External sources.

Configure Azure Event Hubs connector

On the Select a data source page, select Azure Event Hubs.
If there's an existing connection to your Azure event hub, you select that existing connection as shown in the following image, and then move on to the step to configure Data format in the following steps.
On the Connect page, select New connection.
In the Connection settings section, do these steps:
1. Enter the name of the Event Hubs namespace.
2. Enter the name of the event hub.
In the Connection credentials section, do these steps:
1. For Connection name, enter a name for the connection to the event hub.
2. For Authentication kind, confirm that Shared Access Key is selected.
3. For Shared Access Key Name, enter the name of the shared access key.
4. For Shared Access Key, enter the value of the shared access key.
5. Select Connect at the bottom of the page.
  
  To get the access key name and value, follow these steps:
  1. Navigate to your Azure Event Hubs namespace page in the Azure portal.
  2. On the Event Hubs Namespace page, select Shared access policies on the left navigation menu.
  3. Select the access key from the list. Note down the access key name.
  4. Select the copy button next to the Primary key.
Now, on the Connect page of wizard, for Consumer group, enter the name of the consumer group. By default, $Default is selected, which is the default consumer group for the event hub.
For Data format, select a data format of the incoming real-time events that you want to get from your Azure event hub. You can select from JSON, Avro, and CSV (with header) data formats.
Select Next at the bottom of the page.
On the Review and create page, review settings, and select Add.

You see that the Event Hubs source is added to your eventstream on the canvas in the Edit mode. To implement this newly added Azure event hub, select Publish on the ribbon.

Screenshot that shows the editor with Publish button selected.

After you complete these steps, the Azure event hub is available for visualization in the Live view. Select the Event hub tile in the diagram to see the page similar to the following one.

Screenshot that shows the editor in the live view.

To learn how to add other sources to an eventstream, see the following articles:

Prerequisites

Before you start, you must complete the following prerequisites:

Get access to a premium workspace with Contributor or above permissions where your eventstream is located.
You need to have appropriate permission to get event hub's access keys. The event hub must be publicly accessible and not behind a firewall or secured in a virtual network.

Note

The maximum number of sources and destinations for one eventstream is 11.

Add an Azure event hub as a source

If you have an Azure event hub created with streaming data, follow these steps to add an Azure event hub as your eventstream source:

Select New source on the ribbon or "+" in the main editor canvas and then Azure Event Hubs.
Enter a source name for the new source and select a cloud connection to your Azure event hub.
If you don’t have a cloud connection, select Create new connection to create one. To create a new connection, fill in the Connection settings and Connection credentials of your Azure event hub, and then select Create.
- Event Hub namespace: Enter the name of your Azure event hub namespace.
- Event Hub: Enter the name of your Azure event hub in the Azure portal.
- Connection name: Enter a name for the cloud connection.
- Shared access key name and Shared access key: Go to your Azure event hub and create a policy with Manage or Listen permission under Share access policies. Then use policy name and primary key as the Shared Access Key Name and Shared Access Key.
After you create a cloud connection, select the refresh button, and then select the cloud connection you created.
Select a Data format of the incoming real-time events that you want to get from your Azure event hub.

Note

The event streams feature supports the ingestion of events from Azure Event Hubs in JSON, Avro, and CSV (with header) data formats.
Select a Consumer group that can read the event data from your Azure event hub and then select Add.