Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,577 questions
Azure OpenAI service Intermittent 500 Internal server error
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(121.6, 57.00000000000001%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
Zhenqi
10
Reputation points
Hi , We are experimenting with Azure OpenAI services. It seems around half of the time, it will return 500 internal server error with gpt-35-turbo. Is this a known issue and something wrong with the Azure OpenAI services?
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(147.20000000000002, 27%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EV%3C/text%3E%3C/svg%3E)
VasimTamboli 5,110 Reputation points2023-06-04T11:51:11.3266667+00:00 Here are a few steps you can take to troubleshoot the issue:
Retry the request: If you encounter a 500 Internal Server error, you can try retrying the request after a short period of time. Transient errors can occur, and retrying may result in a successful response.
Check service status: Visit the Azure status page (status.azure.com) to check if there are any ongoing issues or service disruptions with Azure OpenAI services. Look for any reported incidents or updates related to the service you're using.
Review error details: When you receive a 500 Internal Server error, check if the error response provides any additional details or error codes. This information can help in troubleshooting and understanding the specific issue.
- Monitor error frequency: Keep track of how frequently you're encountering the 500 Internal Server errors. If the errors persist and occur consistently, it's recommended to report the issue to the Azure support team. They can investigate the problem and provide further assistance.
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 4%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVM%3C/text%3E%3C/svg%3E)
VasaviLankipalle-MSFT 18,386 Reputation points2023-06-06T02:57:08.7266667+00:00 Hi @Zhenqi , Thanks for using Microsoft Q&A Platform.
Could you please share the region you were using? Have you checked for the service health in the Azure portal or found any logs related to this?
-
Zhenqi 10 Reputation points
2023-06-06T23:22:32.7733333+00:00 Hi @VasaviLankipalle-MSFT , sure, I am using East US region. Yes, I see many "Health event" Activated -> In Progress -> Resolved logs in the activity log, almost once every hour. And when I look at the details, it shows here in the properties. Is there something wrong with the Server?
"properties": { "title": "Unknown", "details": "Unknown", "currentHealthStatus": "Unavailable", "previousHealthStatus": "Degraded", "type": "Downtime", "cause": "Unknown" }, -
Zhenqi 10 Reputation points
2023-06-06T23:27:34.34+00:00 We also see "Azure OpenAI Service - East US - Mitigated, Service Issue, Azure OpenAI Service, East US,
6/2/2023 23:14:42" in the health history. It is saying already mitigated, but we are still seeing this Intermittent 500 Internal server error today. -
Zhenqi 10 Reputation points
2023-06-06T23:31:17.34+00:00 We also see "Azure OpenAI Service - East US - Mitigated, Service Issue, Azure OpenAI Service, East US, 6/2/2023, 23:14:" in the health history. It is saying already mitigated, but we are still facing this intermittent 500 internal server error today.
-
VasaviLankipalle-MSFT 18,386 Reputation points
2023-06-07T00:45:50.51+00:00 Hello @Zhenqi , Thanks for sharing this with us. Let me check with the PG team on this.
-
Zhenqi 10 Reputation points
2023-06-10T04:46:41.03+00:00 Hi @VasaviLankipalle-MSFT , thank you! So any update for this? It's still happening and seems the service is not that stable...
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 64%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E0I%3C/text%3E%3C/svg%3E)
01 iccth 5 Reputation points2023-06-10T15:45:38.1766667+00:00 我也经常遇到这个, 我现在直接把请求加进自动循环里, 感觉平均3次就会报一次500错误, 太频繁了
-
Zhenqi 10 Reputation points
2023-06-15T20:27:32.36+00:00 是啊，这个 service 的 quality 有点弱，不太好使用。。。
-
Zhenqi 10 Reputation points
2023-06-15T20:36:27.7566667+00:00 Hi @VasaviLankipalle-MSFT , the OpenAI service starts to return other errors frequently since last couple of days, "deployment not found", "timeout" etc. It seems very unstable, which hurts our user experience. I don't think it's a production ready service for us now, so we canceled and disabled the Azure OpenAI service for our product. If in the future, the team fix these issues and make the service stable, I could give another try.
-
VasaviLankipalle-MSFT 18,386 Reputation points
2023-06-16T03:02:02.4533333+00:00 Hello @Zhenqi , we are sorry to hear about your experience. We have forwarded this feedback to the product team already. Will reach out to you if we hear back from the team.
Sign in to comment
Sign in to answer