Best Logic App configuration for maximum throughput for EventHub trigger

Mahesh Gupta Tallada 26 Reputation points
2023-12-09T12:36:50.6366667+00:00

Hi Team,

We are building an Azure Standard Logic app with EventHub trigger. Could you please help in providing all the modes of configuration (example: additional storage accounts) and their respective values and any other things that provides maximum throughput.

#Standard Logic Apps

#EventHub trigger

#Configuration

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,895 questions
Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
567 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Amira Bedhiafi 16,146 Reputation points
    2023-12-09T15:32:30.62+00:00

    You may need to verify that the Logic App is set to scale automatically(check under the Workflow Settings in your Logic App. For the event hub, you can use a partitioned consumer model. More partitions mean more parallelism and higher throughput. Consider using Event Hubs Dedicated clusters if the expected load is very high.

    Try also to increase the batch size to process more messages per trigger invocation. However, be mindful of the message size and the processing time.

    You can use Azure Blob Storage with high throughput and low latency for large or intermediate data storage needs.

    Each action in the Logic App can add latency so you may need to minimize the number of actions and use the parallel processing capabilities of Logic Apps where applicable. Don't forget that the long-running operations can block the processing of other messages.

    You can use Azure Monitor and Application Insights for diagnostics and to identify performance bottlenecks.

    If your Logic App interacts with other Azure services or external endpoints, consider network optimization strategies like Azure ExpressRoute for more predictable network performance.

    For even higher throughput and performance, consider deploying your Logic App in an Integration Service Environment (ISE), which provides dedicated resources.

    Here are some links to help :

    https://learn.microsoft.com/en-us/azure/logic-apps/logic-apps-limits-and-config?tabs=consumption%2Cazure-portal

    https://techcommunity.microsoft.com/t5/azure-integration-services-blog/scaling-logic-app-standard-for-high-throughput-scenarios/ba-p/3866731

    https://learn.microsoft.com/en-us/azure/architecture/serverless/event-hubs-functions/performance-scale

    0 comments No comments