We frequently encounter "Request timed out" when we use Azure OpenAI Service. (especially in gpt-4 model)

Tatsuya Furukawa 0 Reputation points
2024-03-24T15:33:50.15+00:00

We are using Azure OpenAI.

We are developing an application using ChatGPT's Json mode.

We are using gpt-4 in US East 2, but we frequently encounter "Request timed out" errors.

We also tried in Australia and Japan East, but we couldn't select a gpt-4 model that supports json mode, and furthermore, timeouts occur even with gpt-3.5.

We want to make gpt-3.5 and gpt-4 available stably in each region. What should we do?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,054 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.