Chat request for Azure OpenAI deployment with model gpt-4o-mini not working

Andreas Herbig 20

When creating a new deployment with the gpt-4o-mini model, any requests to via the Chat API return with a 500 server error:

Backend returned unexpected response. Please contact Microsoft for help. | Apim-request-id: eafc9765-65b7-4765-af92-7991337132bb

The same requests work perfectly fine on deployments using model gpt-35-turbo or gpt-4o

Is there anything I can do to fix this?

Andreas Herbig 20 Reputation points

2024-09-24T15:25:18.2833333+00:00
Interesting. Yes that is indeed the issue.

I was indeed trying to use it for the region westeurope and can now see that in the "Standard" deployments this model is unavailable.

Then I have follow up question:
We are currently using a deployment using the gpt-35-turbo (0301) version, which is the only model available in the region.
As stated here https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/model-retirements, this version will be retired on January 27, 2025 with automatic updates to version gpt-35-turbo(0125) starting November 13, 2024.

Will gpt-35-turbo(0125) be available as "Standard" deployment for the westeurope region in the foreseeable future, and can we ensure that our service will still be available?

Will the gpt-4o models become available as "Standard" deployment options for the westeurope region?

Would be really great to get some information on this
romungi-MSFT 45,731 Reputation points Microsoft Employee

2024-09-24T18:01:26.65+00:00

@Andreas Herbig For your existing 0301 deployment in west Europe, it should be upgraded to 0125 which is currently not in this region for standard deployment. As per the model retirement update page automatic updates should happen from November 13th 2024.

With respect to gpt-4o availability in the same region, I do not have that visibility, you can follow the What's new page to check updates from the product team.

Also, moved my earlier comment as an answer, please feel free to accept if it helped. Thanks!!

Accepted answer

romungi-MSFT 45,731 Reputation points Microsoft Employee

2024-09-24T14:25:59+00:00

@Andreas Herbig GPT-4o-mini is not available in all regions as GPT-4o or gpt-35-turbo. You might want to check if the deployment you are trying is supported in your region. See the table for supported regions here. One previous user had similar issue with region where they were trying the same from west europe where the model is not supported.
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Chat request for Azure OpenAI deployment with model gpt-4o-mini not working

0 additional answers

Your answer