Why are calls to OpenAI API timing out?

James O 50 Reputation points
2023-05-12T23:49:55.12+00:00

I have an Azure app service that utilizes the OpenAI GPT API and the requests frequently timeout; however, the API calls work fine outside of Azure. I have many apps outside of Azure that utilize the exact same OpenAI API and they have NEVER timed out, yet whenever I run the same calls from Azure, they timeout.

I have seen other users are having the same issue so it has nothing to do with my app/code.

Is there anyone that can offer advice?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,431 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
7,149 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Tom-4269 10 Reputation points
    2023-08-09T05:28:56.7366667+00:00

    Try switching region, looks like East-US is problematic and has high rate of API timeouts.

    2 people found this answer helpful.
    0 comments No comments

  2. Usman Ahmad 0 Reputation points
    2023-08-07T14:52:37.1466667+00:00

    Same issue. Sometimes the request gets stuck for 10 minutes which results in really poor user experience.
    Moreover, there is no way we are near the rate-limit as per our deployment.