Azure AI Studio - Mistral Small deployment (Serverless API) repeated error "Request failed with status code 500..."

J2RC 10 Reputation points
2024-07-12T06:07:01.98+00:00

Hello,

I'm getting a repeated error in Azure AI Studio, Mistral Small model deployment (Serverless API), when trying to chat with it in the chat playground. The following repeated error: "Request failed with status code 500. Clear the output to start a new dialog".

I tried many times to clear the output or refresh the page to start a new dialog, but the problem persists. I also tried also to delete the deployment and created a new one but I'm getting the same error. If I go to the deployment page it shows Provisioning state / Endpoint state: Succeeded.

It seems to me that there is a problem with this specific model, all the other models that I tested until now are working fine including Mistral Large.

How can I debug the deployment? Could someone tell me what's the issue?

Thanks in advance

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,897 questions
{count} vote

1 answer

Sort by: Most helpful
  1. J2RC 10 Reputation points
    2024-09-19T17:20:30.74+00:00

    Unfortunately I wasn't able to solve the issue. But it might not worth spending more time on this, the Mistral Small model is already considered a legacy model, better to use Mistral Nemo or wait for Mistral-Small-Instruct-2409 (released a few days ago) to be available in Azure AI Studio.

    1 person found this answer helpful.
    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.