How to resolve "Status code 500, no healthy upstream" error

Question

Hello, I'm frequently encountering the error message "Status code 500, no healthy upstream" on the Azure OpenAI SDK. I don't believe the issue is related to capacity. Are there any ways to resolve this error?

Here is the error message I'm getting:

`` `com.azure.core.exception.HttpResponseException: Status code 500, "no healthy upstream" ```

at com.azure.core.implementation.http.rest.RestProxyBase.instantiateUnexpectedException(RestProxyBase.java:381)

at com.azure.core.implementation.http.rest.SyncRestProxy.ensureExpectedStatus(SyncRestProxy.java:133)

at com.azure.core.implementation.http.rest.SyncRestProxy.handleRestReturnType(SyncRestProxy.java:211)

at com.azure.core.implementation.http.rest.SyncRestProxy.invoke(SyncRestProxy.java:86)

at com.azure.core.implementation.http.rest.RestProxyBase.invoke(RestProxyBase.java:124)

at com.azure.core.http.rest.RestProxy.invoke(RestProxy.java:95)

at com.sun.proxy.$Proxy41.getChatCompletionsSync(Unknown Source)

at com.azure.ai.openai.implementation.OpenAIClientImpl.getChatCompletionsWithResponse(OpenAIClientImpl.java:1688)

at com.azure.ai.openai.OpenAIClient.getChatCompletionsWithResponse(OpenAIClient.java:329)

at com.azure.ai.openai.OpenAIClient.getChatCompletions(OpenAIClient.java:696)

Answer 1

Hello everyone,

Thanks for reaching out to us, there is a known issue which under investigation and fix stage by product team.

For some of the areas, a hot fix has been released, please also retry to see if you are still blocked, if yes, please share the region and model to us.

I will update here again once we get any news.

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.