OpenAI service timeout issue

Dean Chen 20 Reputation points
2023-07-17T12:34:06.82+00:00

Hi team,

we are using AZure openAI service 3.5-tubro model, but we are facing a very critical timeout issue everyday,

seems over 40% requests received the timeout response, the initial timeout setting is 600s, may I know where I

can contact the technical support for this?

the error as below:

Request timed out: HTTPSConnectionPool(host=***.openai.azure.com', port=443): Read timed out.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,696 questions
{count} votes

5 answers

Sort by: Most helpful
  1. Jayson Cunanan 0 Reputation points
    2023-07-30T05:12:07.3266667+00:00

    Same problem here.

    0 comments No comments

  2. Tom-4269 10 Reputation points
    2023-08-08T11:45:04.88+00:00

    We're facing similar issues, sporadic timeouts and random long reply times eventually failing with the same error mentioned here.

    Request timed out: HTTPSConnectionPool(host='xxx.openai.azure.com', port=443): Read timed out. (read timeout=40), retrying in 1 seconds...


  3. Tom-4269 10 Reputation points
    2023-08-09T04:51:50.0866667+00:00

    Are you also in East-US region?

    I noticed that Azure OpenAI instances in East-US region has around 10%-20% response failure rate when using repetitive curl requests comparing to other regions. As a workaround we switched to another region and seeing much less timeouts and faster response times.

    0 comments No comments

  4. Stefan 20 Reputation points
    2023-08-09T09:01:08.3333333+00:00

    We have the exact same issue, we are not in East-US region.

    0 comments No comments

  5. QINGMING LUO 0 Reputation points
    2023-11-22T03:09:14.9866667+00:00

    same problem ,how to set timeout param


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.