Same problem here. For me, the only solution is to restart my container.
Azure OpenAI hangs on requests when using GPT-4 model in Canada East region
Vitaly Melnitchuk
15
Reputation points
Hello,
We have a GPT-4 model deployed in the Azure OpenAI Service platform in the Canada East region
As of today (2023-10-24) at around 6:20AM UTC, almost all the requests we do to the model (chat completion requests) hangs indefinitely (this happens also in the chat playground for any input)
I don't see any downtime on the Azure Status page, any reason why this might be happening and how can we debug/investigate this?