Azure OpenAI Service - 503 and timeout errors in Sweden Central for GPT4o Standard

WanisElabbar-4383 205

Hello,

After a period of good service, the GPT-4o model in Sweden Central has stopped responding both in our app and the AI Studio. Could this be investigated, please? I cannot use other "standard" regions as this is the only one in a GDPR-compliant territory.

Thanks

AshokPeddakotla-MSFT 35,091 Reputation points

2024-10-15T08:56:21.17+00:00

WanisElabbar-4383 Greetings!

After a period of good service, the GPT-4o model in Sweden Central has stopped responding both in our app and the AI Studio. Could this be investigated, please? I cannot use other "standard" regions as this is the only one in a GDPR-compliant territory.

I understand your concern. This seems like a transient issue and no issues are reported now in Sweden Central region.

I would suggest you, check Azure Service Health page for any known issues.

Also, please clear the browser cache and try again to check if that works.
Michał Sondej 25 Reputation points

2024-10-15T09:02:38.0966667+00:00

+1, there is definitely an outage happening right now. No gpt-4o deployments are currently possible in the swedencentral region and currently deployed bots do not respond.
I guess we'll see something on the Azure status pages soon.
Camiel Kerkhofs 20 Reputation points

2024-10-15T09:06:40.6+00:00

+1, same issue
Gustav Wessberg 25 Reputation points

2024-10-15T09:07:59.7+00:00

Our GPT-4o deployments in Sweden Central are not working either.
WanisElabbar-4383 205 Reputation points

2024-10-15T09:08:50.45+00:00

I don't mean to be rude but i would appreciate a little bit more attention because you have clearly not understood my concern. The GPT4o model (both versions) in Sweden is unresponsive with both api calls and the AI studio.
Magnus Smed 25 Reputation points

2024-10-15T09:12:01.78+00:00

I agree. It has been really unstable for the last few weeks as we see increased latency issues and now internal server errors on Sweden Central.
Joel 5 Reputation points

2024-10-15T09:12:05.0233333+00:00

Came here to +1. Also having issues calling chatgpt-4o models in Sweden Central
WanisElabbar-4383 205 Reputation points

2024-10-15T09:21:13.2033333+00:00

The operation was timeout. | Apim-request-id: 2a58f5d9-7497-48dc-8b2c-fd8cddeb4073
Patrick Beckedorf 5 Reputation points

2024-10-15T09:25:59.33+00:00

+1 This seems to be a major outage for around 2 hours now, there is no workaround. It was working shortly again for a few minutes but its throwing timeouts again. Tested with different regions, e.g. France Central, no timeouts there, so its Sweden Central related.
Patrick Beckedorf 5 Reputation points

2024-10-15T09:30:19.7066667+00:00

~ duplicate
Haeussinger, Florian 5 Reputation points

2024-10-15T09:36:45.2466667+00:00

+1 same issue here
AshokPeddakotla-MSFT 35,091 Reputation points

2024-10-15T09:37:14.79+00:00

I'm checking on this issue internally and update you as earliest.

Appreciate for your time and patience.
F,M 10 Reputation points

2024-10-15T09:38:27.2133333+00:00

GPT4o is always running into a timeout in SWE
Christoph Schuster 45 Reputation points

2024-10-15T09:49:45.0433333+00:00

Even the OpenAi Studio Web UI gives Timeouts for GTP 4o in Sweden AND EastUS
Kamil Żytka 5 Reputation points

2024-10-15T10:17:13.1266667+00:00

Same for me. Even Azure AI Studio is slow and is giving timeouts on chat playground.
Alexander Kleinen 0 Reputation points

2024-10-15T10:43:53.48+00:00

+1, same for our deployment instance
Alan Tetich 105 Reputation points

2024-10-15T10:46:00.51+00:00

+1, same issue for deployments in Sweden Central and same for portal chat.
It hasn't worked for us for 4 hours
Magnus Smed 25 Reputation points

2024-10-15T10:56:45.9733333+00:00

@AshokPeddakotla-MSFT Any update on this?
Hassan, Youssef 10 Reputation points

2024-10-15T11:06:37.63+00:00

+1, same issue for Sweden Central instance
Alan Tetich 105 Reputation points

2024-10-15T11:14:38.43+00:00

Ok, I have a workaround.
When I create a new deployment but for the model version 2024-05-13 the model started working.

early deployment for the following version still returns a timeout for me
Moumen Omar 0 Reputation points

2024-10-15T11:18:04.52+00:00

We have the same issue 😕
Hassan, Youssef 10 Reputation points

2024-10-15T11:18:16.9+00:00

+1, same issue for Sweden Central instance
Dominik Odermatt 55 Reputation points

2024-10-15T11:23:36.5466667+00:00

+1 same issue here other regions seem to be working.
Valentin Gîță 0 Reputation points

2024-10-15T11:58:41.25+00:00

+1, same issue for Sweden Central instance
Valentin Gîță 0 Reputation points

2024-10-15T11:59:21.2366667+00:00

+1, same issue for Sweden Central instance
Mse 5 Reputation points

2024-10-15T12:06:37.9433333+00:00

We also have problems with the GPT-4o model in Sweden Central.
Audun 40 Reputation points

2024-10-15T12:19:46.0466667+00:00

This is a critical error for us, as we both need to host our model in EU and we need structured outputs. Thus, we can't change to US or another version of the model.
Martin Rypar 10 Reputation points

2024-10-15T13:10:36.66+00:00

+1 for this issue.

gpt-4o-08-06 deployments seems to struggle both under Standard and Global Standard regimes. The latency is huge for them. Tested also deployments in different regions (US East, Poland, Sweden) with the same results.
Dominik Odermatt 55 Reputation points

2024-10-15T13:27:17.9733333+00:00

Why is there no event posted on https://azure.status.microsoft/ ?
Christoph Schuster 45 Reputation points

2024-10-15T15:34:12.7433333+00:00

Now i get in Sweden an :
"no healthy upstream | Apim-request-id: 9e8b66d4-551c-4f30-92fe-5942d0ed2640".At least the errors are changing :-)
Silta Finance 5 Reputation points

2024-10-15T18:33:00.3733333+00:00

Any updates on this? Getting the same error 500 no healthy upstream. Using gpt-4o Global Standard in US East.
Josh Brewer 0 Reputation points

2024-10-15T18:39:21.49+00:00

Something is definitely broken in US East with gpt-4o global standard (2024-08-01-preview) sometimes 90 seconds to respond to a 'hi', sometimes 'no healthy upstream'
Christoph Schuster 45 Reputation points

2024-10-16T09:10:33.4433333+00:00

AshokPeddakotla-MSFT any updates why this happened and how to prevent this day long outages?
AshokPeddakotla-MSFT 35,091 Reputation points

2024-10-16T15:47:44.6933333+00:00

Hello All,

Apologies for the inconvenience caused.

Our team is actively working on deploying a hotfix to mitigate the issue.

As a temporary workaround, you can switch to model version 2024-05-13.
Magnus Smed 25 Reputation points

2024-10-17T14:20:29.3266667+00:00

@AshokPeddakotla-MSFT Still issues here.

It's been more than two days now with issues.

I did get a confirmation on Service Health that all was good, but does not seems like again. Issues started again 10:30 UTC today.
Liam Andrew 25 Reputation points

2024-10-17T14:44:24+00:00

Microsoft, this issue needs proper attention, the Azure Status site (https://azure.status.microsoft/en-gb/status) has been showing Sweden Central OpenAI Service as green this whole time eventhough it's been almost unusable for a number of days now.
Davide Crescini 0 Reputation points

2024-10-17T15:08:11.5266667+00:00

+1, same issue here.
Christoph Schuster 10 Reputation points

2024-10-17T16:20:41.8866667+00:00

AshokPeddakotla-MSFT Version 2024-05-13 is not an option, as it does not deliver structured data as result, and out app need this.
Fatih Yildiz 5 Reputation points

2024-10-17T17:28:49.87+00:00

Still getting issues (503 or drastically delayed results with poor quality) with our deployments in sweden central. It is a disgrace that Microsoft doesn't even acknowledge this issue in the status page, let alone inform us directly.
WanisElabbar-4383 205 Reputation points

2024-10-18T08:33:19.58+00:00

It does look like the model version is still within the preview life cycle, so they have an "excuse" :D
AdamAlfredsson-4177 5 Reputation points

2024-10-21T07:03:13.7+00:00

It works now, but I would really appreciate some report from MS about this incident – can we rely on Azure OpenAI going forward?

Accepted answer

Alan Tetich 105 Reputation points

2024-10-15T11:15:24.8633333+00:00

Ok, I have a workaround. When I create a new deployment but for the model version 2024-05-13 the model started working.

early deployment for the following version still returns a timeout for me even as I created a new deployment
Please sign in to rate this answer.

4 people found this answer helpful.
Moumen Omar 0 Reputation points

2024-10-15T11:19:42.4633333+00:00

I go back to gpt4 turbo since version 13-5-2024 not return the same result i expect

WanisElabbar-4383 205 Reputation points

2024-10-15T12:04:20.01+00:00

Falling back to May 2024 works for now...

Edi Wang 5 Reputation points MVP

2024-10-15T13:07:15.19+00:00

GPT-4o 2024-05-13 works fine in text, but timeout still happens when sending images to it.

HASAN AYDOGAR (3RD) 0 Reputation points

2024-10-16T11:00:34.3166667+00:00

But it's lack of some tools features with this model versiyon. :( . model version: 2024-08-06 works like 2024-05-13.

Alan Tetich 105 Reputation points

2024-10-16T11:02:30.2633333+00:00

My old instance(model version: 2024-08-06) started working without a huge delay and timeout.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

1 additional answer

AshokPeddakotla-MSFT 35,091 Reputation points

2024-10-21T01:38:58.4133333+00:00

Hello Everyone,

This issue has been resolved.

A Hotfix has been rolled out in the affected regions. Further communication will be sent to affected customers to confirm that the issue has been resolved and to provide any necessary updates.

please check and update if you are still facing this issue.
Please sign in to rate this answer.
Edu Hermida 50 Reputation points

2024-10-21T09:18:31.98+00:00

I'm still unable to create a Regional deployment in Sweden Central for the 4o-mini model...

AshokPeddakotla-MSFT 35,091 Reputation points

2024-10-22T10:07:34.31+00:00

Your issue looks like a different one. Can you create a new issue with complete details for further assistance?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure OpenAI Service - 503 and timeout errors in Sweden Central for GPT4o Standard

1 additional answer

Your answer