GPT-4o Chat Completion API with Image Input Extremely Slow and Timing Out

Rodrigo Juarez 20 Reputation points
2024-05-31T20:38:59.0933333+00:00

I am experiencing extremely slow response times and frequent timeouts when using the Chat Completion API with the GPT-4o model and image inputs. The issue is happening for me at East US 2 region. Testing on 2 totally different accounts and deployments over the same region.

I would appreciate it if the Azure OpenAI team could investigate this issue and provide a solution or an estimated timeline for a fix.

Same issue reported here https://learn.microsoft.com/en-us/answers/questions/1689233/gpt-4o-chat-completion-api-with-image-input-extrem?comment=question#newest-question-comment

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,462 questions
0 comments No comments
{count} votes

Accepted answer
  1. AshokPeddakotla-MSFT 29,906 Reputation points
    2024-06-03T02:07:08.5133333+00:00

    Rodrigo Juarez Greetings & Welcome to Microsoft Q&A forum!

    Thanks for confirming that its working for you.

    We had a known issue regarding this and hotfix has been deployed to production by our team. The payload has rollout to all the regions.

    Appreciate your time and patience in this regard.

    If the issue resolved, please do click Accept Answer and Yes for was this answer helpful.

    2 people found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful