Making requests to Azure OpenAI's gpt-4o model results in random 500 errors (model_not_ready)

Andy Kachelmeier 20 Reputation points
2024-10-15T18:04:55.79+00:00

We keep running into random bouts of receiving an error when attempting a Chat Completion request to Azure OpenAI's gpt-4o model (2024-08-06) (Global Standard).

Status: 500 (model_not_ready)

   at Azure.AI.OpenAI.ClientPipelineExtensions.ProcessMessageAsync(ClientPipeline pipeline, PipelineMessage message, RequestOptions options)
   at Azure.AI.OpenAI.Chat.AzureChatClient.CompleteChatAsync(BinaryContent content, RequestOptions options)
   at OpenAI.Chat.ChatClient.CompleteChatAsync(IEnumerable`1 messages, ChatCompletionOptions options, CancellationToken cancellationToken)
   at Microsoft.SemanticKernel.Connectors.OpenAI.ClientCore.RunRequestAsync[T](Func`1 request)

The error eventually goes away, but the stability is an issue. There is plenty of capacity available for our deployment to handle our requests.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,917 questions
0 comments No comments
{count} votes

Accepted answer
  1. YutongTie-MSFT 53,941 Reputation points
    2024-10-15T20:27:35.5433333+00:00

    @Andy Kachelmeier Thanks for reaching out to us, this is an ongoing outage which is under fixing right now. I will update here again once there is any update.

    Regards,

    Yutong

    -Please kindly accept the answer if you feel helpful to support the community, thanks a lot.


1 additional answer

Sort by: Most helpful
  1. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.


    Comments have been turned off. Learn more

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.