ServiceBusTrigger consume all active messages instead of newly created message

Question

ServiceBusTrigger consume all active messages instead of newly created message

Saranraj C 0

Hi this is Saran.

We are using azure service bus. And producing message to service bus topic.

We have created one azure function ServiceBusTrigger for consuming message from service bus topic. ServiceBusTrigger is working when ever new message produced in topic. But ServiceBusTrigger function consuming all active messages instead of newly created one. We want to consume only new message from topic.

For example:

Consider already 10 active message available in topic.

Now we are producing message number 11.

That time ServiceBusTrigger trigger working but it fetching all 11 messages instead of fetching last message (11th message).

Kindly give you suggestion to consume only new message.

Thanks.

Patchfox 4,176 Reputation points

2024-01-10T07:55:39.5533333+00:00

Hi Saranraj C I want to help you with this question.

Which class do you use in your code to process the messages?

Without more info, I would recommend using this class:

https://learn.microsoft.com/en-us/java/api/com.azure.messaging.servicebus.servicebusreceiverclient?view=azure-java-stable

With it, it's possible to get only the last message but set a Peek_Lock.

If the reply was helpful, please don’t forget to upvote or accept it as an answer, thank you!

Saranraj C 0

Hi @Patchfox ,

Below c# azure function code, we are using for consume message from service bus topic.

public class Function1
    {
        [FunctionName("Function1")]
        public static void Run(
            [ServiceBusTrigger("Topic_CA","Subscription_CA", Connection = "ServiceBusConnectionString_CA",AutoComplete =false)]
            string message,
            Int32 deliveryCount,
            ServiceBusReceivedMessage messageReceiver,
            ILogger log
            )
        {
            log.LogInformation($"Consumed address change details from topic produced by CRM: {message}");
        }

    }

Saranraj C 0 Reputation points

2024-01-10T08:08:39.81+00:00
Hi @Patchfox ,

Based on this code I want consume only last produced message instead of all messages.

But this function ServiceBusTrigger consuming all messages when we produce new message in topic.

For example:

Consider already 10 active message available in topic.

Now we are producing message number 11.

That time ServiceBusTrigger trigger working but it fetching all 11 messages instead of fetching last message (11th message).

Kindly give you suggestion to consume only new message.

public class Function1 { [FunctionName("Function1")] public static void Run( [ServiceBusTrigger("Topic_CA","Subscription_CA", Connection = "ServiceBusConnectionString_CA",AutoComplete =false)] string message, Int32 deliveryCount, ServiceBusReceivedMessage messageReceiver, ILogger log ) { log.LogInformation($"Consumed address change details from topic produced by CRM: {message}"); } }
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-19T10:30:56.21+00:00

Hi @Saranraj C
Following up to see if my answer helps. Feel free to get back to me if you need any assistance.

Please 'Accept Answer' if it helped so that it can help others in the community looking for help on similar topics.
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-23T14:21:19.3+00:00

Hi @Saranraj C

I hope the answer helps. Feel free to get back to me if you need any assistance.

Please 'Accept Answer' if it helped so that it can help others in the community looking for help on similar topics.

2 answers

Your answer

Patchfox 4,176 Reputation points

2024-01-10T07:55:39.5533333+00:00

Hi Saranraj C I want to help you with this question.

Which class do you use in your code to process the messages?

Without more info, I would recommend using this class:

https://learn.microsoft.com/en-us/java/api/com.azure.messaging.servicebus.servicebusreceiverclient?view=azure-java-stable

With it, it's possible to get only the last message but set a Peek_Lock.

If the reply was helpful, please don’t forget to upvote or accept it as an answer, thank you!
Saranraj C 0 Reputation points

2024-01-10T08:03:50.2+00:00

Hi @Patchfox ,

Below c# azure function code, we are using for consume message from service bus topic.

public class Function1 { [FunctionName("Function1")] public static void Run( [ServiceBusTrigger("Topic_CA","Subscription_CA", Connection = "ServiceBusConnectionString_CA",AutoComplete =false)] string message, Int32 deliveryCount, ServiceBusReceivedMessage messageReceiver, ILogger log ) { log.LogInformation($"Consumed address change details from topic produced by CRM: {message}"); } }
Saranraj C 0 Reputation points

2024-01-10T08:08:39.81+00:00

Hi @Patchfox ,

Based on this code I want consume only last produced message instead of all messages.

But this function ServiceBusTrigger consuming all messages when we produce new message in topic.

For example:

Consider already 10 active message available in topic.

Now we are producing message number 11.

That time ServiceBusTrigger trigger working but it fetching all 11 messages instead of fetching last message (11th message).

Kindly give you suggestion to consume only new message.

public class Function1 { [FunctionName("Function1")] public static void Run( [ServiceBusTrigger("Topic_CA","Subscription_CA", Connection = "ServiceBusConnectionString_CA",AutoComplete =false)] string message, Int32 deliveryCount, ServiceBusReceivedMessage messageReceiver, ILogger log ) { log.LogInformation($"Consumed address change details from topic produced by CRM: {message}"); } }
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-19T10:30:56.21+00:00

Hi @Saranraj C
Following up to see if my answer helps. Feel free to get back to me if you need any assistance.

Please 'Accept Answer' if it helped so that it can help others in the community looking for help on similar topics.
MayankBargali-MSFT 70,941 Reputation points Moderator

2024-01-23T14:21:19.3+00:00

Hi @Saranraj C

I hope the answer helps. Feel free to get back to me if you need any assistance.

Please 'Accept Answer' if it helped so that it can help others in the community looking for help on similar topics.

Answer 1

Ben Gimblett 4,560 Microsoft Employee

Hi - Thanks for the question, the problem here is in the way you are asking SB trigger to handle the message

[ServiceBusTrigger("Topic_CA","Subscription_CA", Connection = "ServiceBusConnectionString_CA",AutoComplete =false)]

This is the problem

AutoComplete =false

There are in effect two modes of operation

(1) the default is the message handed to your function code has a "peek lock" assigned. Depending on how the code finishes, when the function exits the lock is either completed (the message is removed as it's been processed) or the lock is removed so another instance can retry the message processing (for example the function threw an exception)

(2) auto complete - you can opt out of using peek lock and auto-complete BUT if you do this you need to complete the message (or abandon it) manually in code yourself. I suspect you are not doing this. Not doing this means you see the same messages over and over again as they never get removed

Answer is also explained here https://stackoverflow.com/questions/62752905/azure-function-service-bus-trigger-running-multiple-times

Ben Gimblett 4,560 Reputation points Microsoft Employee

2024-01-10T12:03:15.41+00:00

generally speaking I would recommend using the default peek lock functionality , especially with functions , as it ensures your message is removed (if the function finishes as you expect) or the lock is removed so the message can be retried (redelivered to another func instance) if something goes wrong. It's a lot less effort and dependable.
Also, functions renews the lock automatically if the function doesnt finish on time REF https://learn.microsoft.com/en-us/azure/azure-functions/functions-bindings-service-bus-trigger?tabs=python-v2%2Cisolated-process%2Cnodejs-v4%2Cextensionv5&pivots=programming-language-csharp#peeklock-behavior
Ben Gimblett 4,560 Reputation points Microsoft Employee

2024-01-10T12:03:57.4933333+00:00

For a wider view on locks and how Service Bus works see here https://learn.microsoft.com/en-us/azure/service-bus-messaging/message-transfers-locks-settlement

Answer 2

Saranraj C Thanks for reaching out. The azure function service bus or any service bus SDK consumes all the messages that are present in a particular subscription. Unfortunately, there is no out of box way to consume the messages from a particular number etc. In case if you know which messages to consume then you can abandoned those messages so those can be discarded or moved to the dead letter queue as per your service bus entity configuration. Ben has already shared some of the reference documents.

Let me know if you have any queries or concerns.

Please 'Accept Answer' if it helped so that it can help others in the community looking for help on similar topics.

Share via

ServiceBusTrigger consume all active messages instead of newly created message

2 answers

Your answer