Unable to consume more than the limit

Mahendra Sawarkar 40

Hi Please find the the EventHub Details below: PricingTier: Standard ThroughputUnit: 40 RetentionPeriod: 7Days EventHub Location: USEast region Consumer Location: Europe region

PartitionCount: 32 We are trying to consume as fast as possible from EventHub using Kafka Client, but we are seeing some limitations while doing that, as the EventHub is configured at the customer level we are not able to debug much on that part, customer has shared below graph with us 23JanScreenshot

If you can see in the Throughput graph, the red line is very straight, I don't know if that's the limit while consuming the EventHub. After calculation we could consume only about 41.34GB per hour. Is that a limit per Standard tier? can you please guide us on this?

Mahendra Sawarkar 40 Reputation points

2024-01-23T11:28:27.8333333+00:00

As per the infrastructure they have and as per the guide https://learn.microsoft.com/en-us/answers/questions/1509069/unable-to-consume-more-than-the-limit 40TPU = 40 * 2MB ps = 80 MBPS = 4800MB per minute = 288000MB per hour = 281.25GB per hour which is far more than the 41.34GB (we are consuming) can you please check if this calculation is correct
PRADEEPCHEEKATLA-MSFT 77,516 Reputation points Microsoft Employee

2024-01-24T00:45:07.46+00:00
@Mahendra Sawarkar - Thanks for the question and using MS Q&A platform.

According to the official documentation: Azure Event Hubs quotas and limits

The limit for a Standard tier Event Hub with 40 throughput units is 80 MB per second, which translates to 288,000 MB per hour or 281.25 GB per hour. However, you are only able to consume about 41.34 GB per hour, which is significantly lower than the expected limit.

There could be several reasons why you are not able to consume data at the expected rate. One possibility is that there are network or connectivity issues between your consumer location in Europe and the Event Hub location in USEast. Another possibility is that there are issues with your Kafka client configuration or implementation.

To troubleshoot this issue further, I would recommend checking the following:

Check the network connectivity between your consumer location and the Event Hub location. You can use tools like ping or traceroute to check for any network issues.

Check your Kafka client configuration and implementation to ensure that it is optimized for high throughput. You may want to consider using batch processing or increasing the number of consumer instances to improve throughput.

Check the Event Hub metrics to see if there are any issues with the Event Hub itself. You can use Azure Monitor to view metrics such as incoming and outgoing messages, data volume, and throughput.

If you are still experiencing issues after checking these items, I would recommend to open a support ticket for further assistance.
PRADEEPCHEEKATLA-MSFT 77,516 Reputation points Microsoft Employee

2024-01-30T01:17:11.88+00:00

@Mahendra Sawarkar - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Mahendra Sawarkar 40 Reputation points

2024-01-30T11:17:05+00:00
Hi @PRADEEPCHEEKATLA-MSFT Thanks for answering and sorry for the delay what I found is even if we optimise the code, the throughput was not increasing in standard tier. when we changed the Tier from Standard to Premium without changing the code, the egress throughput was increased 10 times. Not sure if its expected behaviour. are below properties works as expected while configuring the KafkaConsumer:

fetch.min.bytes fetch.max.wait.ms

In the below documentation these properties are not listed: https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations#consumer-configurations-only-1 with below explanation, it looks like only Kafka protocol is enabled and not all Kafka properties can be configured for EventHub consumption, is it true? https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-frequently-asked-questions?source=recommendations#does-azure-event-hubs-run-on-apache-kafka-
Mahendra Sawarkar 40 Reputation points

2024-01-30T11:27:53.35+00:00
@PRADEEPCHEEKATLA-MSFT Thanks for the comment and sorry for the delay in response We ran multiple tests against the EventHub after optimising the code and found the egress throughput was not going beyond the limits I shared before. But when we changed the Tier from standard to Premium the throughput was increased by 10 times. I tried playing with below Kafka consumer properties, but looks like it has no effect while consuming the Kafka

fetch.min.bytes fetch.max.wait.ms

I checked the EventHub Official Documentation and there these properties are not mentioned, does that mean setting these properties wont show any effect while consuming the EventHub? Reference: https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations#consumer-configurations-only-1 looks like those will work with Kafka broker only. as the EventHub is not implemented on top on Kafka these properties wont work, please correct me if I am wrong Reference: https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-frequently-asked-questions?source=recommendations#does-azure-event-hubs-run-on-apache-kafka- Please comment, Thanks!