Eventhub partition reader communication

2022-10-04T17:40:42.927+00:00

We have one design 32 client read from 32 partition.When one reader gets a "RUN" commands ,it needs to know all consumer finished their reads before run command.Why we need to this one,Because we need to be sure all the messages read."run" command can be put one of the partitions.

How can they communicate each other?
is there any pattern or global sequence number.

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
568 questions
{count} votes

1 answer

Sort by: Most helpful
  1. KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee
    2022-10-11T01:07:39.75+00:00

    Hello @Sahsuvaroglu, Muhammed (GE Digital) ,

    As per the discussion with internal team, for the receive path, partitions are completely independent. There is no cross-partition coordination or global sequence number. If you need to accumulate a particular group of messages before performing an operation, then you will need to implement the logic to do that. Have you considered using partition keys? If all messages in a group can be stamped with the same partition key, then they will all go to the same partition and therefore the same receiver, which simplifies the problem a lot. Since there are no ordering guarantees between messages sent by different producers, you may still have to deal with the situation where the RUN command is in the middle of the group, but again that’s a simpler problem to solve when all the messages are in one partition.

    Hope this info helps.

    0 comments No comments