Same problem here.
OpenAI service timeout issue
Hi team,
we are using AZure openAI service 3.5-tubro model, but we are facing a very critical timeout issue everyday,
seems over 40% requests received the timeout response, the initial timeout setting is 600s, may I know where I
can contact the technical support for this?
the error as below:
Request timed out: HTTPSConnectionPool(host=***.openai.azure.com', port=443): Read timed out.
5 answers
Sort by: Most helpful
-
-
Tom-4269 10 Reputation points
2023-08-08T11:45:04.88+00:00 We're facing similar issues, sporadic timeouts and random long reply times eventually failing with the same error mentioned here.
Request timed out: HTTPSConnectionPool(host='xxx.openai.azure.com', port=443): Read timed out. (read timeout=40), retrying in 1 seconds...
-
Tom-4269 10 Reputation points
2023-08-09T04:51:50.0866667+00:00 Are you also in East-US region?
I noticed that Azure OpenAI instances in East-US region has around 10%-20% response failure rate when using repetitive curl requests comparing to other regions. As a workaround we switched to another region and seeing much less timeouts and faster response times.
-
Stefan 20 Reputation points
2023-08-09T09:01:08.3333333+00:00 We have the exact same issue, we are not in East-US region.
-
QINGMING LUO 0 Reputation points
2023-11-22T03:09:14.9866667+00:00 same problem ,how to set timeout param