o1 models on azure openai respond too slowly or not at all

Question

o1 models on azure openai respond too slowly or not at all

Jump Engineering 5

All my other deployments work fine, like 4o etc, but when I deploy an o1 model, it response extremely slowly or not at all (via the api)

In the playground, I asked "what is 2+2" and it took 3 minutes to answer

YutongTie-MSFT 53,941 Reputation points

2025-02-21T22:57:27.8133333+00:00

@Jump Engineering Thanks for reaching out to us, could you please confirm if you are in EastUS2 region or SwedenCentral region? If yes, there is an ongoing issue which caused a unexpected latency for response.

I will update you the status here daily until this issue has been mitigated, as of today, there is no ETA, but there are several tickets opening to product team and product team is investigating this issue.

I hope this helps.

Regards,

Yutong
Jump Engineering 5 Reputation points

2025-02-22T01:17:25.91+00:00

Yes eastus2 region. Thanks, keep me posted
Pedro Castelo Branco Lourenço 41 Reputation points

2025-02-22T09:05:38.79+00:00

@YutongTie-MSFT , why Microsoft do not change the Service Status to the real status? It has been now more than 4 days that o1 and o3-mini mare simoly unusable(Sweden). I see soo many people complaining about this and theres no official communication or any ETA? How to trust on this service?
YutongTie-MSFT 53,941 Reputation points

2025-02-23T04:49:38.08+00:00

@Jump Engineering Today's update, engineer team is working on a hot fix for this issue.

@Pedro Castelo Branco Lourenço Thanks for your feedback, we already shared this feedback to product team for better customer experience, some understanding from product team - these are public preview services which don't fall under our SLAs for communications. The Azure portal is only used for niche, broad impact or indeterminable impact situations as per the link on the status page that explains all here: https://learn.microsoft.com/en-us/azure/service-health/azure-status-overview#when-does-azure-publish-communications-to-the-status-page

I hope in the near future this experience can be improve after we shared the feedback, appreciate to support our community here.

Regards,

Yutong
YutongTie-MSFT 53,941 Reputation points

2025-02-24T05:55:41.5866667+00:00

@Jump Engineering No new update during the weekend, we are looking forward to seeing more update on Monday, will keep you posted. Thanks.

Regards,

Yutong
YutongTie-MSFT 53,941 Reputation points

2025-02-25T01:26:10.1233333+00:00

Hello @Jump Engineering I just got an update that the fixing for East US 2 region will be released by tomorrow (or later today), so please check tomorrow to see if your issue has been resolved or not.

@Pedro Castelo Branco Lourenço The fix for Sweden Central has been released, please check if the latency issue resolved.

Thanks!

Regards,

Yutong
Jump Engineering 5 Reputation points

2025-02-25T22:49:32.7233333+00:00

I just tested and it's still timing out
Jump Engineering 5 Reputation points

2025-02-25T23:09:16.6766667+00:00

I just tried and its still timing out
YutongTie-MSFT 53,941 Reputation points

2025-02-25T23:11:28.4333333+00:00

@Jump Engineering Acknowledged, I am waiting for a confirmation from product team side, will let you know once they confirm again.
YutongTie-MSFT 53,941 Reputation points

2025-02-26T02:28:27.8133333+00:00

@Jump Engineering Thank you for your patience. Latest update and for EastUS2 region -

Since this issue was caused by limit capacity, the product team update the design to enable dynamic routing which will solve time out issues.

The dynamic routing is built and will be release step by step, hope to cover most of the customers by the end of this week.

There are some options for now, one is Provisioned Managed sku for latency sensitive workload, and you may want to switch to other regions as alternative plan for this week.

Please refer to this document to Provisioned Managed sku - https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/provisioned-throughput-onboarding

Other regions/version for o1 -

https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions#global-standard-model-availability

I will update here again once this issue confirmed resolved, will let you know more, I hope this helps.

Regards,

Yutong

1 answer

Your answer

YutongTie-MSFT 53,941 Reputation points

2025-02-21T22:57:27.8133333+00:00

@Jump Engineering Thanks for reaching out to us, could you please confirm if you are in EastUS2 region or SwedenCentral region? If yes, there is an ongoing issue which caused a unexpected latency for response.

I will update you the status here daily until this issue has been mitigated, as of today, there is no ETA, but there are several tickets opening to product team and product team is investigating this issue.

I hope this helps.

Regards,

Yutong
Jump Engineering 5 Reputation points

2025-02-22T01:17:25.91+00:00

Yes eastus2 region. Thanks, keep me posted
Pedro Castelo Branco Lourenço 41 Reputation points

2025-02-22T09:05:38.79+00:00

@YutongTie-MSFT , why Microsoft do not change the Service Status to the real status? It has been now more than 4 days that o1 and o3-mini mare simoly unusable(Sweden). I see soo many people complaining about this and theres no official communication or any ETA? How to trust on this service?
YutongTie-MSFT 53,941 Reputation points

2025-02-23T04:49:38.08+00:00

@Jump Engineering Today's update, engineer team is working on a hot fix for this issue.

@Pedro Castelo Branco Lourenço Thanks for your feedback, we already shared this feedback to product team for better customer experience, some understanding from product team - these are public preview services which don't fall under our SLAs for communications. The Azure portal is only used for niche, broad impact or indeterminable impact situations as per the link on the status page that explains all here: https://learn.microsoft.com/en-us/azure/service-health/azure-status-overview#when-does-azure-publish-communications-to-the-status-page

I hope in the near future this experience can be improve after we shared the feedback, appreciate to support our community here.

Regards,

Yutong
YutongTie-MSFT 53,941 Reputation points

2025-02-24T05:55:41.5866667+00:00

@Jump Engineering No new update during the weekend, we are looking forward to seeing more update on Monday, will keep you posted. Thanks.

Regards,

Yutong
YutongTie-MSFT 53,941 Reputation points

2025-02-25T01:26:10.1233333+00:00

Hello @Jump Engineering I just got an update that the fixing for East US 2 region will be released by tomorrow (or later today), so please check tomorrow to see if your issue has been resolved or not.

@Pedro Castelo Branco Lourenço The fix for Sweden Central has been released, please check if the latency issue resolved.

Thanks!

Regards,

Yutong
Jump Engineering 5 Reputation points

2025-02-25T22:49:32.7233333+00:00

I just tested and it's still timing out
Jump Engineering 5 Reputation points

2025-02-25T23:09:16.6766667+00:00

I just tried and its still timing out
YutongTie-MSFT 53,941 Reputation points

2025-02-25T23:11:28.4333333+00:00

@Jump Engineering Acknowledged, I am waiting for a confirmation from product team side, will let you know once they confirm again.
YutongTie-MSFT 53,941 Reputation points

2025-02-26T02:28:27.8133333+00:00

@Jump Engineering Thank you for your patience. Latest update and for EastUS2 region -

Since this issue was caused by limit capacity, the product team update the design to enable dynamic routing which will solve time out issues.

The dynamic routing is built and will be release step by step, hope to cover most of the customers by the end of this week.

There are some options for now, one is Provisioned Managed sku for latency sensitive workload, and you may want to switch to other regions as alternative plan for this week.

Please refer to this document to Provisioned Managed sku - https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/provisioned-throughput-onboarding

Other regions/version for o1 -

https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models?tabs=global-standard%2Cstandard-chat-completions#global-standard-model-availability

I will update here again once this issue confirmed resolved, will let you know more, I hope this helps.

Regards,

Yutong

Answer 1

@Jump Engineering Thanks for reporting this issue again, the latency issue should be mitigated right now. Please check and let us know if you are still facing this issue.

As product team confirmed that this issue has been mitigated, I will convert this comment to answer so that we can close this case.

Appreciate the reporting and your patience again.

I hope this helps!

Regards,

Yutong

-Please kindly accept the answer if you feel helpful to support the community, feel free to reach out to us if you see further issues.

Share via

o1 models on azure openai respond too slowly or not at all

1 answer

Your answer