Azure OpenAI service responding very slow

hoohack 35 Reputation points
2023-06-02T01:12:14.5733333+00:00

Hi ,

We are experimenting with Azure OpenAI services. We are using GPT-3(text-davinci-003) and gpt-35-turbo for our use case but the performance of the endpoint is not consistent.

We found a lot of requests that exceed 10s, sometimes taking 10 secs to respond and sometime the same call takes 2.5 sec, how to solve them?

Our Region is East US

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,592 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. YutongTie-MSFT 48,341 Reputation points
    2023-06-03T10:25:20.06+00:00

    Hello @hoohack

    Thanks for reaching out to us.

    This is a known issue which has been reported by EastUS customers, the product team is investigating this issue. I will let you know once any update, thanks for your patience again.

    Regards,

    Yutong

    -Please kindly accept the answer if you feel helpful to support the community, thanks a lot.