Unable to set up batch processing in Azure service bus with azure function trigger

Question

Unable to set up batch processing in Azure service bus with azure function trigger

Bhavin Dave 0

Hi,

I am trying to set up a service bus and have my azure function trigger whenever there is a message on queue. My single message processing is working fine. But I instead want to process a batch of messages. I specified the batch settings in host.json as well as tried adding a functions.json (was not available by default). Spend more than 20 hours but am still not able to make batch processing work. Documentation is extremely poor and is not helping either. I am getting close to my production deployment timeline. Appreciate your help and guidance.

Thanks

Bhavin

Sai Prabhu Naveen Parimi 2,265 Reputation points Microsoft External Staff Moderator

2025-02-24T17:39:02.9433333+00:00
Bhavin Dave

Welcome to Microsoft Q&A Platform! Thank you for reaching out.

To get your batch processing working for Azure Functions, here are the key steps:

Check host.json Configuration: Make sure your host.json file is correctly configured for batch processing. Here is an example configuration:

{ "version": "2.0", "extensions": { "serviceBus": { "messageHandlerOptions": { "maxConcurrentCalls": 16, "autoComplete": false }, "batchOptions": { "maxMessageCount": 100, "operationTimeout": "00:05:00" } } } }

Function Code: Ensure your function code is set up to handle batch processing. Here is an example:

[FunctionName("ServiceBusQueueTrigger")] public static async Task Run( [ServiceBusTrigger("myqueue", Connection = "ServiceBusConnection", IsBatched = true)] Message[] messages, ILogger log) { foreach (var message in messages) { log.LogInformation($"C# ServiceBus queue trigger function processed message: {message.Body}"); } }

If you still face issues, please provide more details about your current configuration and any error messages you are encountering. I'll do my best to assist you further.
Bhavin Dave 0 Reputation points

2025-02-24T17:51:54.9066667+00:00

I have added the appropriate configuration in host.json. However, my function_app is in python. What is the python equivalent for IsBatched = true ?

import azure.functions as func

import logging

import json

from typing import List

app = func.FunctionApp()

@app.service_bus_queue_trigger(arg_name="azservicebus", queue_name="videoinputqueue",

connection="SERVICE_BUS_CONNECTION_STR")

def servicebus_trigger1(azservicebus: List[func.ServiceBusMessage]):

logging.info('Python ServiceBus Queue trigger processed a message: %s',

azservicebus.get_body().decode('utf-8'))
Bhavin Dave 0 Reputation points

2025-02-24T17:57:36.45+00:00

My azure function is in python. What is the python equivalent for isBatched = true
Sai Prabhu Naveen Parimi 2,265 Reputation points Microsoft External Staff Moderator

2025-02-26T01:51:15.15+00:00

Bhavin Dave

Just checking in to see if the steps provided below for configuring batch processing in Azure Functions helped resolve your issue. Have you had a chance to try them out.

Let me know if you need any further assistance.

1 answer

Your answer

Sai Prabhu Naveen Parimi 2,265 Reputation points Microsoft External Staff Moderator

2025-02-24T17:39:02.9433333+00:00

Bhavin Dave

Welcome to Microsoft Q&A Platform! Thank you for reaching out.

To get your batch processing working for Azure Functions, here are the key steps:

Check host.json Configuration: Make sure your host.json file is correctly configured for batch processing. Here is an example configuration:

{ "version": "2.0", "extensions": { "serviceBus": { "messageHandlerOptions": { "maxConcurrentCalls": 16, "autoComplete": false }, "batchOptions": { "maxMessageCount": 100, "operationTimeout": "00:05:00" } } } }

Function Code: Ensure your function code is set up to handle batch processing. Here is an example:

[FunctionName("ServiceBusQueueTrigger")] public static async Task Run( [ServiceBusTrigger("myqueue", Connection = "ServiceBusConnection", IsBatched = true)] Message[] messages, ILogger log) { foreach (var message in messages) { log.LogInformation($"C# ServiceBus queue trigger function processed message: {message.Body}"); } }

If you still face issues, please provide more details about your current configuration and any error messages you are encountering. I'll do my best to assist you further.
Bhavin Dave 0 Reputation points

2025-02-24T17:51:54.9066667+00:00

I have added the appropriate configuration in host.json. However, my function_app is in python. What is the python equivalent for IsBatched = true ?

import azure.functions as func

import logging

import json

from typing import List

app = func.FunctionApp()

@app.service_bus_queue_trigger(arg_name="azservicebus", queue_name="videoinputqueue",

connection="SERVICE_BUS_CONNECTION_STR")

def servicebus_trigger1(azservicebus: List[func.ServiceBusMessage]):

logging.info('Python ServiceBus Queue trigger processed a message: %s',

azservicebus.get_body().decode('utf-8'))
Bhavin Dave 0 Reputation points

2025-02-24T17:57:36.45+00:00

My azure function is in python. What is the python equivalent for isBatched = true
Sai Prabhu Naveen Parimi 2,265 Reputation points Microsoft External Staff Moderator

2025-02-26T01:51:15.15+00:00

Bhavin Dave

Just checking in to see if the steps provided below for configuring batch processing in Azure Functions helped resolve your issue. Have you had a chance to try them out.

Let me know if you need any further assistance.

Answer 1

Hello Bhavin Dave,

Thanks for posting your question in the Microsoft Q&A forum.

Let's go through the steps to configure batch processing correctly:

Update host.json: Ensure your host.json file includes the following configuration for Service Bus:

{
  "version": "2.0",
  "extensions": {
    "serviceBus": {
      "prefetchCount": 100,
      "messageHandlerOptions": {
        "autoComplete": true,
        "maxConcurrentCalls": 16,
        "maxAutoRenewDuration": "00:05:00"
      },
      "batchOptions": {
        "maxMessageCount": 1000,
        "operationTimeout": "00:00:30"
      }
    }
  }
}

Update Function Code: Modify your Azure Function to handle batches of messages. Here's an example in C#:

[FunctionName("ServiceBusBatchTrigger")]
public static async Task Run(
    [ServiceBusTrigger("myqueue", Connection = "ServiceBusConnection")] ServiceBusReceivedMessage[] messages,
    ILogger log)
{
    foreach (var message in messages)
    {
        log.LogInformation($"Processed message: {message.Body}");
    }
}

Batch Size: The actual number of messages in a batch may vary depending on the current load and message availability. Azure Functions will try to optimize based on your settings and the current state of the queue

Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful

Share via

Unable to set up batch processing in Azure service bus with azure function trigger

1 answer

Your answer