How to resolve openai.InternalServerError: no healthy upstream error

Andrea Quarta 30

Oct 15, 2024, 4:11 PM

Hello,

I'm frequently encountering the error message "no healthy upstream" on the Azure OpenAI SDK.

i deploy a chat bot with azure openai service and i've never encountered this error before.

Are there any ways to resolve this error?

Model:

gpt-4o
2024-08-06
Sweden Central

VasaviLankipalle-MSFT 18,576 Reputation points

Oct 15, 2024, 5:55 PM

Hello @Andrea Quarta , Thanks for using Microsoft Q&A Platform.

This is an ongoing issue, and it has been reported by several customers today. The PG team is actively working on the fix. We will update you with more information as soon as we receive further details.
COHEN Antoine 0 Reputation points

Oct 16, 2024, 7:58 AM

Hello @VasaviLankipalle-MSFT

Do you have any news regarding this issue?

We are currently encountering the same problems and response latency seems very high, it takes minutes to get a response from the model.

Thank you.

1 answer

VasaviLankipalle-MSFT 18,576 Reputation points

Oct 16, 2024, 10:36 PM

Hello @Andrea Quarta , COHEN Antoine Thanks for your time and patience throughout this issue.

As an update for this issue, the Hotfix rollout is in progress in multiple regions, with Sweden Central and UK South completed.

Also, as a temporary work around, you can switch to this model version: 2024-05-13

I hope this helps.

Regards,

Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer