Issues with Serverless AI models - Cohere reranker

Question

Issues with Serverless AI models - Cohere reranker

Roni Mateless 40

Hi, on 17/02 the cohere reranker deployed in EastUS was so slow. is there a place to see known issues/status of the serverless models? In case there is a problem what are the options? another region?

1 answer

Your answer

Answer 1

SriLakshmi C 6,250 Microsoft External Staff Moderator

Hello Roni Mateless,

Greetings and Welcome to Microsoft Q&A!

Currently, there is no dedicated platform mentioned to check for known issues or the status of serverless AI models, including the Cohere reranker. If you experience performance issues, such as slowness, one possible solution is to deploy the model in a different region. Since EastUS is a high-demand region, it may face occasional slowdowns due to increased usage. Consider deploying the reranker in other regions, such as East US 2, North Central US, or any available region with sufficient capacity. This can help mitigate performance issues and ensure smoother operation.

I hope you understand. And, if you have any further query do let us know.

If this answers your query, do click Accept Answer and Yes for was this answer helpful.

Thank you!

SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2025-02-19T10:23:49.3333333+00:00

Hi oni Mateless,

Just checking in to see if the below answer helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Thank you!
Roni Mateless 40 Reputation points

2025-02-19T10:38:23.2766667+00:00

Unfortunately, after moving from EastUS to East US2 and to north CentralUS the model still slowly. around 20 seconds instead of 1-2 seconds when working through Cohere infrastructure. Looks like something else
Roni Mateless 40 Reputation points

2025-02-19T10:40:26.8266667+00:00

Hi SriLakshmi, thanks for your answer!
Unfortunately, after moving from EastUS to East US2 and to north CentralUS the model still slowly. around 20 seconds instead of 1-2 seconds when working through Cohere infrastructure. Looks like something else
JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-02-21T04:55:01.44+00:00

Hi @Roni Mateless ,

If you see the status page on 17/02/ there are no known issues but on 21/02 there was Investigating Elevated Error Rate on Rerank V3 English and Multilingual, know issue has been resolved and it's back to normal.

Please check it once now and do let me know if any query.
JAYA SHANKAR G S 3,960 Reputation points Microsoft External Staff Moderator

2025-02-24T03:26:07.8266667+00:00

Hi @Roni Mateless ,

I believe the above suggestion helped you, and do let me know if any query.

Thank you.

Share via

Issues with Serverless AI models - Cohere reranker

1 answer

Your answer