Time out (408) on Azure OpenAI gpt-4o deployment version 2024-08-06

Question

Time out (408) on Azure OpenAI gpt-4o deployment version 2024-08-06

Jeroen van der Heide 21

Hello,

Since two days, I consistently get a time out (HTTP code 408) when inferencing with gpt-4o model version 2024-08-06 on Azure OpenAI Service (Sweden Central) - even on the chat playground on oai.azure.com.

The operation was timeout. | Apim-request-id: 1b171116-8382-46b9-a3e6-66e6972657c3

Model version 2024-05-13 on the same service works fine, both in the chat playground and in our user application.

I tried creating a support request myself but the service resides in a subscription managed by our corporate CSP so I am unable to - and they have been slow to respond. Please advise.

Stewart Snow 0 Reputation points

2024-10-17T15:14:13.08+00:00

Hi @VasaviLankipalle-MSFT ,

It's not just the Sweden Central region - we're seeing the same issue in EastUs. "Standard Deployments" are being more reliable, but our "Global Standard" ones are mostly failing with 408.

It's basically not been right at all since Tuesday's fun and games.

Regards

Stewart
Syed Mohsin Abbas 5 Reputation points

2024-10-17T15:25:21.03+00:00

The timeout issue (HTTP 408) with GPT-4o version 2024-08-06 is likely related to a regional service problem in Sweden Central. The model version 2024-05-13 works fine, so switching to this version temporarily is recommended while the issue is being resolved. Contact your CSP to escalate the support request for a faster response.

1 answer

Your answer

Stewart Snow 0 Reputation points

2024-10-17T15:14:13.08+00:00

Hi @VasaviLankipalle-MSFT ,

It's not just the Sweden Central region - we're seeing the same issue in EastUs. "Standard Deployments" are being more reliable, but our "Global Standard" ones are mostly failing with 408.

It's basically not been right at all since Tuesday's fun and games.

Regards

Stewart
Syed Mohsin Abbas 5 Reputation points

2024-10-17T15:25:21.03+00:00

The timeout issue (HTTP 408) with GPT-4o version 2024-08-06 is likely related to a regional service problem in Sweden Central. The model version 2024-05-13 works fine, so switching to this version temporarily is recommended while the issue is being resolved. Contact your CSP to escalate the support request for a faster response.

Answer 1

VasaviLankipalle-MSFT 18,676 Moderator

Hello @Jeroen van der Heide , Thanks for using Microsoft Q&A Platform.

This is an ongoing issue in multiple regions, and it has been reported by several customers.

The PG team is actively working on the fix. We will update you with more information.

As a temporary work around, you can switch to this model version: 2024-05-13.

Gölz, Michael 0 Reputation points

2024-10-22T08:25:56.7233333+00:00

Do you have any status update?
Hereandthereandback 0 Reputation points

2024-10-28T10:32:31.74+00:00

Any update here?
Ahzam Fawmee 10 Reputation points

2025-02-25T10:24:39.4666667+00:00

Is it a repeated thing i face this like very 2,3 month when they release a new model

Share via

Time out (408) on Azure OpenAI gpt-4o deployment version 2024-08-06

1 answer

Your answer