Azure Open AI service Internal Error 500

Avenash Kabeera 0

Recently I've been getting 500 model_errors when calling openAI deployment:

Region: US East 2

Here is an example log

2024-07-23 00:06:51,788 - INFO - HTTP Request: POST ......openai.azure.com/openai/deployments/nextvestment-gpt-4o/chat/completions?api-version=2023-03-15-preview "HTTP/1.1 500 model_error"
error occurred in /chat endpoint: Error code: 500 - {'error': {'message': 'The server had an error processing your request. Sorry about that! You can retry your request, or contact us through an Azure support request at: https://go.microsoft.com/fwlink/?linkid=2213926 if you keep seeing this error. (Please include the request ID a1f8acad-8f3b-4dd0-8c33-4c3a1296990f in your email.)', 'type': 'server_error', 'param': None, 'code': None}}

AshokPeddakotla-MSFT 34,701 Reputation points

2024-07-23T03:53:12.57+00:00

Avenash Kabeera Greetings & Welcome to Microsoft Q&A forum!

Are you still seeing this issue?

This could be a transient failure. Retyring after some time will work.
YutongTie-MSFT 52,866 Reputation points

2024-07-23T03:56:26.9966667+00:00

Hello Avenash,

Thanks for reaching out to us, if you are in EastUS 2 and get error like 503 etc. It is high possibility that because the region capacity reached to max capacity. Will give an update soon.
Avenash Kabeera 0 Reputation points

2024-07-23T04:10:43.46+00:00

Hello AshokPeddakotla, I am seeing this issue 100% of my requests so I don't think it's a transient failure. And it's been happening since last night and is still happening right now.

Is there any other details I can provide to help look into the issue?
AshokPeddakotla-MSFT 34,701 Reputation points

2024-07-23T06:18:20.0066667+00:00

Avenash Kabeera Thanks for the confirmation. As Yutong mentioned, We will check and update you as earliest on the capacity constraints.
Avenash Kabeera 0 Reputation points

2024-07-23T06:20:09.19+00:00

FYI I deployed to another region and the requests are working now. Is there a way we can see the status of each region and their health. (sorry for the noob question, I'm new to Azure).

These issue were consistently happening for the past 12 hours with no idea how or why. My clients could not use any functionality of our app all night. It'll be great to have some status page to know what's going on. The Open AI Azure logs don't have any useful information and the only thing we have to debug the issue is "500 model error"
Avenash Kabeera 0 Reputation points

2024-07-23T06:26:28.65+00:00

Sorry if this turns up as spam, I added a comment and it's nowhere to be seen.

Original comment:
FYI I deployed a model on a different region and it seems to work now. Is there a way to see the status and health of OpenAI services for each region? (sorry for a noob question, I am new to Azure)

Or where is the best place to check for statuses when errors like this occurs? The OpenAI Azure logs don't have any helpful information and we can use for debugging is "500 model error."

Any suggestions will be appreciated
AshokPeddakotla-MSFT 34,701 Reputation points

2024-07-23T06:44:19.03+00:00

Avenash Kabeera You can check Azure Service Health page. This page provides personalized alerts and guidance for Azure service issues.
AshokPeddakotla-MSFT 34,701 Reputation points

2024-08-20T16:38:18.6633333+00:00

This issue has been resolved. Could you please update if you are still seeing the same issue?

Share via

Azure Open AI service Internal Error 500

Your answer