Overview of Azure Event Hubs dedicated tier
Event Hubs clusters offer single-tenant deployments for customers with the most demanding streaming needs. This single-tenant offering has a guaranteed 99.99% SLA and is available only on our dedicated pricing tier. An Event Hubs cluster can ingress millions of events per second with guaranteed capacity and subsecond latency. Namespaces and event hubs created within the dedicated cluster include all features of the premium offering and more, but without any ingress limits. It also includes the popular Event Hubs Capture feature at no additional cost. The Event Hubs Capture feature allows you to automatically batch and log data streams to Azure Storage or Azure Data Lake Storage.
Clusters are provisioned and billed by capacity units (CUs), a pre-allocated amount of CPU and memory resources. You can purchase 1, 2, 4, 8, 12, 16 or 20 CUs for each cluster. How much you can ingest and stream per CU depends on various factors, such as the following ones:
- Number of producers and consumers
- Payload shape
- Egress rate
All Event Hubs clusters are Kafka-enabled by default and support Kafka endpoints that can be used by your existing Kafka based applications. Having Kafka enabled on your cluster does not affect your non-Kafka use cases. There is no option or need to disable Kafka on a cluster.
Why dedicated tier?
The dedicated tier of Event Hubs offers three compelling benefits for customers who need enterprise-level capacity:
Single-tenancy guarantees capacity for better performance
A dedicated cluster guarantees capacity at full scale. It can ingress up to gigabytes of streaming data with fully durable storage and subsecond latency to accommodate any burst in traffic.
Inclusive and exclusive access to features
The dedicated offering includes features like Event Hubs Capture at no additional cost and exclusive access to features like Bring Your Own Key (BYOK). The service also manages load balancing, operating system updates, security patches, and partitioning. So, you can spend less time on infrastructure maintenance and more time on building client-side features.
Self-Serve scaling capabilities
The dedicated tier offers self-serve scaling capabilities that allow you to adjust the capacity of the cluster according to dynamic loads and to facilitate business operations. You can scale out during spikes in usage and scale in when the usage is low. To learn how to scale your dedicated cluster, see Scale Event Hubs dedicated clusters.
Quotas and limits
The Event Hubs dedicated offering is billed at a fixed monthly price, with a minimum of 4 hours of usage. The dedicated tier offers all the features of the premium plan, but with enterprise-scale capacity and limits for customers with demanding workloads.
For more information about quotas and limits, see Event Hubs quotas and limits
High availability with availability zones
Event Hubs standard, premium, and dedicated tiers offer availability zones support where you can run event streaming workloads in physically separate locations within each Azure region that are tolerant to local failures.
Event Hubs dedicated clusters require at least 8 Capacity Units(CUs) to enable availability zones. Clusters with self-serve scaling does not support availability zones yet. Availability zone support is only available in Azure regions with availability zones.
How to onboard
Event Hubs dedicated tier is generally available (GA). The self-serve experience to create an Event Hubs cluster through the Azure portal is currently in Preview. You can also request for the cluster to be created by contacting the Event Hubs team.
What can I achieve with a cluster?
For an Event Hubs cluster, how much you can ingest and stream depends on various factors such as your producers, consumers, the rate at which you're ingesting and processing, and much more.
The following table shows the benchmark results that we achieved during our testing:
|Payload shape||Receivers||Ingress bandwidth||Ingress messages||Egress bandwidth||Egress messages||Total TUs||TUs per CU|
|Batches of 100x1KB||2||400 MB/sec||400k messages/sec||800 MB/sec||800k messages/sec||400 TUs||100 TUs|
|Batches of 10x10KB||2||666 MB/sec||66.6k messages/sec||1.33 GB/sec||133k messages/sec||666 TUs||166 TUs|
|Batches of 6x32KB||1||1.05 GB/sec||34k messages / sec||1.05 GB/sec||34k messages/sec||1000 TUs||250 TUs|
In the testing, the following criteria was used:
- A dedicated-tier Event Hubs cluster with 4 capacity units (CUs) was used.
- The event hub used for ingestion had 200 partitions.
- The data that was ingested was received by two receiver applications receiving from all partitions.
Can I scale up/down my cluster?
If you created the cluster with the Support Scaling option set, you can use the self-serve experience, to scale out and scale in as needed. You can scale up to 10 CUs with self-serve scalable clusters. As self-serve scalable dedicated clusters are based out of new infrastructure, they are bound to be performant over dedicated clusters that don't support self-serve scaling. As the performance of dedicated clusters depends on various factors such as resource allocation, number of partitions, storage, and so on, we recommend you to determine the required number of CUs after testing with a real workload.
Submit a support request in the following scenarios to scale out or scale in your dedicated cluster.
- You need more than 10 CUs for a self-serve scalable dedicated cluster (a cluster that was created with the Support scaling option set).
- You need to scale out or scale in a cluster that was created without selecting the Support scaling option
- You need to scale out or scale in a dedicated cluster that was created before the self-serve experience was released
You won't be able to delete the cluster for at least 4 hours after you create it. Therefore, you will be charged for a minimum 4 hours of usage of the cluster. For more information on pricing, see Event Hubs - Pricing.
Can I migrate from non-scalable cluster to scalable cluster?
Due to difference in the backend architecture, we don't currently support migration of clusters that don't support self-serve scaling to self-serve scalable dedicated clusters. If you would wish to use self-serve scaling, you must recreate the cluster with the support for scaling. To learn how to create scalable cluster, see Create an Event Hubs dedicated cluster.
When to scale my dedicated cluster?
CPU consumption is the key indicator of the resource consumption of your dedicated cluster. When the overall CPU consumption is reaching 70% (without observing any abnormal conditions such as high number of server errors or low successful requests), that means your cluster is moving towards its maximum capacity. Therefore you can use this as an indicator to consider whether you need to scale up your dedicated cluster or not.
To monitor the CPU usage of the dedicated cluster, you need to follow these steps.
CPUas the metrics and use the
Maxas the aggregation.
Then add a filter for the property type
Role, use the equal operator and select all three values(
SBSEH) from the dropdown.
Then you can monitor this metric to determine when you should scale your dedicated cluster. You can also set up alerts against this metric to get notified when CPU usage reaches the thresholds you set.
How does Geo-DR work with my cluster?
You can geo-pair a namespace under a dedicated-tier cluster with another namespace under a dedicated-tier cluster. We don't encourage pairing a dedicated-tier namespace with a namespace in our standard offering because the throughput limit will be incompatible and result in errors.
Can I migrate my standard or premium namespaces to a Dedicated-tier cluster?
We don't currently support an automated migration process for migrating your event hubs data from a standard or premium namespace to a dedicated one.
Contact your Microsoft sales representative or Microsoft Support to get additional details about Event Hubs Dedicated. You can also create a cluster or learn more about Event Hubs pricing tiers by visiting the following links:
- Create an Event Hubs cluster through the Azure portal
- Event Hubs Dedicated pricing. You can also contact your Microsoft sales representative or Microsoft Support to get additional details about Event Hubs Dedicated capacity.
- The Event Hubs FAQ contains pricing information and answers some frequently asked questions about Event Hubs.