Azure API Management Instance - Throughput

Question

Azure documentation indicates that the estimated maximum throughput of an API Management Instance in a Premium tier is about 4000 requests/sec. My understanding is that this throughput indicates the number of requests processed by all APIs within that APIM instance per second. Please correct if my understanding is incorrect. If not, my question is

If one of the APIs within the APIM instance is taking too long to respond because of the backend service being unresponsive or slow, will it impact the throughput/performance of other APIs within the APIM instance? If yes, is there a way to implement circuit breaker to reduce the impact. Please clarify.

Answer 1

Hi @Kumar ,

Thanks for reaching out to Q&A forum.

Throughput is affected by the number and rate of concurrent client connections, the kind and number of configured policies, payload sizes, backend API performance, and other factors. The numbers presented in the document were obtained by testing with 1000 concurrent persistent client secure HTTP connections, minimal payload sizes, no policies configured, and a low latency backend API.

So when a backend api is taking a long time to respond, it will affect the throughput of the APIM instance. Ideal way to deal with the backend latency is to optimize the performance of the backend api by caching, scaling, zone redundancy etc.

I hope this helps! Feel free to reach out to me if you have any queries or concerns.

Please 'Accept as answer' and ‘Upvote’ if it helped so that it can help others in the community looking for help on similar topics.