Azure AI Studio - Mistral Small deployment (Serverless API) repeated error "Request failed with status code 500..."

J2RC 0

Hello,

I'm getting a repeated error in Azure AI Studio, Mistral Small model deployment (Serverless API), when trying to chat with it in the chat playground. The following repeated error: "Request failed with status code 500. Clear the output to start a new dialog".

I tried many times to clear the output or refresh the page to start a new dialog, but the problem persists. I also tried also to delete the deployment and created a new one but I'm getting the same error. If I go to the deployment page it shows Provisioning state / Endpoint state: Succeeded.

It seems to me that there is a problem with this specific model, all the other models that I tested until now are working fine including Mistral Large.

How can I debug the deployment? Could someone tell me what's the issue?

Thanks in advance

AshokPeddakotla-MSFT 30,511 Reputation points

2024-07-12T10:18:18.45+00:00

J2RC Greetings & Welcome to Microsoft Q&A forum!

Are you still seeing this issue?

Could you please share the region in which your service is deployed? Have you checked Azure Service Health in the Azure portal or found any logs related to this?

This could be a transient failure If you encounter a 500 Internal Server error, retrying the request after a short period of time will resolve the error.
J2RC 0 Reputation points

2024-07-12T10:46:36.4033333+00:00

Yes, I'm still having this issue (since yesterday afternoon around 16:00 CET).

The service is deployed in Sweden Central. I just checked Azure Service Health now and there are "No active service issues" in Sweden Central.

Thanks!

Share via

Azure AI Studio - Mistral Small deployment (Serverless API) repeated error "Request failed with status code 500..."