Tutorial: Use namespace topics to route MQTT messages to Azure Event Hubs (Azure portal)

In this tutorial, you learn how to use a namespace topic to route data from MQTT clients to Azure Event Hubs.

Prerequisites

• If you don't have an Azure subscription, create an Azure free account before you begin.
• If you're new to Event Grid, read the Event Grid overview before you begin.
• Register the Event Grid resource provider according to the steps in Register the Event Grid resource provider.
• Make sure that port 8883 is open in your firewall. The sample in this tutorial uses the MQTT protocol, which communicates over port 8883. This port might be blocked in some corporate and educational network environments.

Create a namespace in the Azure portal

A namespace in Azure Event Grid is a logical container for one or more topics, clients, client groups, topic spaces, and permission bindings. With an Azure Event Grid namespace, you can group together related resources and manage them as a single unit in your Azure subscription. A unique namespace allows you to have multiple resources in the same Azure region.

To create a namespace:

1. Sign in to the Azure portal.

2. In the search box, enter Event Grid Namespaces and select Event Grid Namespaces from the results.

   

3. On the Event Grid Namespaces page, select + Create.

   

4. On the Basics page, follow these steps.

   1. Select the Azure subscription in which to create the namespace.

   2. Select an existing Resource group or create a resource group.

   3. Enter a Name for the namespace.

   4. Select the Location for the namespace.

   5. Select Review + create.

      

5. On the Review + create tab, review your settings. Then select Create.

6. On the Deployment succeeded page, select Go to resource to navigate to your namespace.

Create a namespace topic

1. If you aren't on the Event Grid Namespace page, follow the create, view, and manage namespaces steps to view the namespace you want to use to create the topic.

2. On the Event Grid Namespace page, under Event broker, select Topics.

3. On the Topics page, select + Topic.

   

4. On the Create Topic page, type the name of the topic you want to create and select Create.

   

Enable managed identity for the Event Grid namespace

1. On the Event Grid Namespace page, under Settings, select Identity.

2. To enable a system assigned managed identity, select On.

3. Select Save to save the setting.

   

4. On the confirmation message, select Yes.

5. Confirm that you see the object ID of the system-assigned managed identity and see a link to assign roles.

   

   Check notifications in the Azure portal to confirm that the managed identity is enabled for the namespace.

Enable MQTT broker for the Event Grid namespace

1. On the Event Grid Namespace page, under Settings, select Configuration.

2. Select Enable MQTT broker.

3. Select Apply.

   

   Check notifications in the Azure portal to confirm that the MQTT broker is enabled for the namespace.

In a separate tab of the Web browser or in a separate window, use the Azure portal to create an Event Hubs namespace with an event hub.

Create an Event Hubs namespace

An Event Hubs namespace provides a unique scoping container in which you create event hubs. To create a namespace in your resource group using the portal:

1. In the Azure portal, from the flyout menu, select All services. In the All services page, search for and select Event Hubs.

   

2. In the Event Hubs page, select Create.

   

3. On the Create namespace page, take the following steps:

   1. Select the Subscription in which you want to create the namespace.

   2. Select the Resource group you created in the previous step.

   3. Enter a name for the namespace. The system immediately checks to see if the name is available.

   4. Select a Region for the namespace.

   5. For the pricing tier, choose Basic.

      Note

      If you plan to use the namespace from Apache Kafka apps, use the Standard tier. The basic tier doesn't support Apache Kafka workloads. To learn about differences between tiers, see Quotas and limits, Event Hubs Premium, and Event Hubs Dedicated articles.

   6. Leave the throughput units (for standard tier) or processing units (for premium tier) setting as it is. To learn about throughput units or processing units, see Event Hubs scalability.

   7. Select Review + Create.

      

   8. On the Review + Create page, review the settings, and select Create. Wait for the deployment to complete.

4. On the Deployment page, select Go to resource to navigate to the page for your namespace.

   

5. Confirm that you see the Event Hubs Namespace page similar to the following example:

   

Create an event hub

To create an event hub within the namespace, do the following actions:

1. On the Overview page, select + Event Hub.

   

2. Type a name for your event hub, then select Review + create.

   

3. On the Review + create page, select Create.

4. You can check the status of the event hub creation in alerts. After the event hub is created, you see it in the list of event hubs.

   

Give Event Grid namespace the access to send events to the event hub

1. On the Event Hubs Namespace page, select Access control (IAM).

2. On the Access control page, select + Add, and then select Add role assignment.

   

3. On the Add role assignment page, from the list of roles, select Azure Event Hubs Data Sender, and then select Next.

   

4. On the Members page, follow these steps:

   1. For the Assign access to field, select Managed identity.

   2. Choose + Select members.

      

5. On the Select managed identities page, follow these steps:

   1. Select your Azure subscription.

   2. For Managed identity, select Event Grid Namespace.

   3. Select the managed identity that has the same name as the Event Grid namespace.

   4. Choose Select.

      

6. On the Add role assignment page, select Review + assign.

7. On the Review + assign page, select Review + assign.

Create an event subscription with Event Hubs as the endpoint

1. Switch to the tab of your Web browser window that has the Event Grid namespace open.

2. On the Event Grid Namespace page, select Topics.

3. On the Topics page, select the namespace topic you created earlier.

   

4. On the Event Grid Namespace Topic page, select + Subscription.

   

5. On the Create Subscription page, follow these steps:

   1. Enter a Name for the event subscription.

   2. For Delivery mode, select Push.

   3. Confirm that Endpoint type is set to Event Hub.

   4. Select Configure an endpoint.

      

   5. On the Select Event Hub page, follow these steps:

      1. Select the Azure subscription that has the event hub.

      2. Select the Resource Group that has the event hub.

      3. Select the Event Hubs Namespace.

      4. Select the Event Hub in the Event Hubs namespace.

      5. Then, select Confirm selection.

         

   6. Back on the Create Subscription page, select System Assigned for Managed identity type.

   7. Select Create.

      

Configure routing in the Event Grid namespace

1. Navigate back to the Event Grid Namespace page by selecting the namespace in the Essentials section of the Event Grid Namespace Topic page or by selecting the namespace name in the breadcrumb menu at the top.

2. On the Event Grid Namespace page, under MQTT broker, select Routing.

3. On the Routing page, select Enable routing.

4. For Topic type, select Namespace topic.

5. For Topic, select the Event Grid namespace topic that you created where all MQTT messages are routed.

6. Select Apply.

   

   Check notifications to confirm that the namespace is enabled with the routing information.

Create clients, topic space, and permission bindings

Follow steps in this quickstart: Publish and subscribe on an MQTT topic to:

1. Create a client. You can create the second client if you want to, but it's optional.

2. Create a topic space.

3. Create publisher and subscriber permission bindings.

4. Use MQTTX to send a few messages.

5. Verify that the event hub received those messages on the Overview page for your Event Hubs namespace.

   

View routed MQTT messages in Event Hubs by using a Stream Analytics query

Navigate to the Event Hubs instance (event hub) in your event subscription in the Azure portal. Process data from your event hub by using Stream Analytics. For more information, see Process data from your event hub using Azure Stream Analytics. You can see the MQTT messages in the query.

Next step

For code samples, go to the MqttApplicationSamples GitHub repository.