Azure Event hub Kafka rebalancing issue

Question

We are using Kafka of Azure event hub. We are loosing some messages due to RebalanceInProgressException in event hub. We get below errors:

1. Join group failed with org.apache.kafka.common.errors.RebalanceInProgressException: The group is rebalancing, so a rejoin is needed.
2. Attempt to heartbeat failed since group is rebalancing.

Please suggest a solution.

Also we would like to configure below properties:
group.initial.rebalance.delay.ms=300000
session.timeout.ms=300000

Please suggest the correct place of configurations.

Answer 1

Hello @Dixit, Pravin ,
Thanks for the question and using MS Q&A platform.
As we understand the ask here is how to get rid of the the rebalcing exception , please do let us know if its not accurate.
On reading some internal document , it appears that you will have to tweak the ( which i think you also are talking abount )

1. group.initial.rebalance.delay.ms
2. session.timeout.ms

Please do read about as to where to make the configuration update as called out in the document here https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations and https://kafka.apache.org/documentation/ .

Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators