Evaluation Failed in Azure Language Custom Sentiment Training

AV 0 Reputation points
2023-12-13T15:08:28.52+00:00

I have tried running custom sentiment analysis model training in the studio. Each time the training completes but then the evaluation fails with the following error:

Evaluation Job Failed, failure msg: `Failed to predict documents for the following reason: `Call to runtime `Failed` while running predictions operation. Runtime message `Failed to process task after several retry``.`, projectName: `<PROJECT_NAME>`, trainedModel: `<MODEL_NAME>



Tried re-running a number of time with always the same result.

Also tried on another region that doesn't help

Tried also with a different storage account and container, also doesn't help.

Do you know what I'm doing wrong?

Azure AI Language
Azure AI Language
An Azure service that provides natural language capabilities including sentiment analysis, entity extraction, and automated question answering.
358 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 42,206 Reputation points Microsoft Employee
    2023-12-14T11:28:00.9333333+00:00

    @AV The error seems to be a runtime evaluation error, this might be due to some format issues in testing data or a backend issue of the service. From your perspective if you have used manual data split before, is it possible to review test data split or use a different set of data for your training and testing with your project?

    If the error is persistent then you will have to raise a support case to get the project reviewed by the service team who has access to the backend logs for training and evaluation. Thanks!!

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments