Azure OpenAI services in multiple regions

DShree 396 Reputation points
2023-07-19T07:34:25.75+00:00

What are the best practices for auto-routing requests to performant regions for OpenAI services hosted in multiple regions on Azure? We are looking for guidance on how to achieve this. Additionally, we would appreciate any advice on how to avoid latency issues and ensure optimal performance. Any specific code snippets or Azure documentation would be helpful in resolving this issue. Thank you.

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,598 questions
{count} votes

Accepted answer
  1. Ramr-msft 17,826 Reputation points
    2023-07-19T08:30:51.7166667+00:00

    @D-0887 Thanks for the question, Here is sample to fails over between regions whenever you exceed rate limit or you can use the APIM.

    https://github.com/kirkhofer/data-ai/tree/main/aoai

    User's image

    Kindly mark the answer as Accepted and Upvote in case it helped!

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.