ERROR: upstream request timeout - Azure OpenAI

Sikder Tahsin Al Amin 175 Reputation points
2023-08-08T14:59:45.3333333+00:00

Does anybody know why I'm getting this error in Azure OpenAI chat playground (Add your data)? I've been getting this error frequently since yesterday. I've paid subscription, my region is East US 2 and my deployed model is gpt35-turbo-16k.

Couple of observations-

  • Its not like the information I request is hard to find which is causing the timeout. It can find the info when it works.
  • Tokens per Minute Rate limit is set to 30K. Not sure if what it means and if that can cause the issue?

Any suggestions would be helpful. Thanks!

User's image

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,236 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Graeme Jones 0 Reputation points
    2023-08-11T09:52:35.7833333+00:00

    I'm also having the same issues. I'm asking a very basic question, and after adding a simple text file I get the error. East US region.

    User's image


  2. Sikder Tahsin Al Amin 175 Reputation points
    2023-11-01T19:43:43.5033333+00:00

    My issue went away when I updated my cognitive service plan. I added 2 replicas to my Basic plan and I saw the problem went away.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.