How-to enable auto create topics for Azure Event Hub - Kafka

Question

Hi.

Some tools we use needs to have auto create topic enabled for Kafka, is that possible to configure when using Kafka with Event Hubs?

Answer 1

@Jesper

Thanks for reaching out to Microsoft Q&A.

Yes, it is possible to enable auto-create topics when using Kafka with Azure Event Hubs. Here’s how you can do it:

Create an Azure Event Hubs Namespace:

• When you create an Event Hubs namespace, the Kafka endpoint for the namespace is automatically enabled. You can stream events from your applications that use the Kafka protocol into Event Hubs.

Enable Auto-Create Topics:

• Azure Event Hubs honors the Kafka producer’s auto.create.topics.enable configuration. When this parameter is set to true (which is the default), topics will be auto-created by the producer.

Configuration Steps:

If you are using an existing Kafka cluster, you can enable automatic topic creation through the Ambari Web UI:

1. From the Azure portal, select your Kafka cluster.
2. From Cluster dashboards, select Ambari home.
3. Select the Kafka service from the list on the left of the page.
4. Select Configs in the middle of the page.
5. In the Filter field, enter auto.create.
6. Change the value of auto.create.topics.enable to true, and then select Save.

Hope this helps. Do let us know if you any further queries.