Azure Custom Vision or Azure Vision AI Confusion Matrix evaluation

Clodagh Lynch 70 Reputation points Microsoft Employee
2024-06-04T14:02:00.3133333+00:00

Hi,

Does anybody know if it's possible to extract a confusion matrix from training results for either Azure AI Custom Vision or Azure Computer Vision Image Analysis?

Thanks.

Azure Computer Vision
Azure Computer Vision
An Azure artificial intelligence service that analyzes content in images and video.
379 questions
Azure AI Custom Vision
Azure AI Custom Vision
An Azure artificial intelligence service and end-to-end platform for applying computer vision to specific domains.
249 questions
{count} votes

1 answer

Sort by: Most helpful
  1. dupammi 8,535 Reputation points Microsoft Vendor
    2024-06-05T07:36:48.8533333+00:00

    Hi @Clodagh Lynch

    Thank you for your question.

    When you navigate to the Performance tab in the Custom Vision portal and select an iteration, it displays performance metrics for each tag in your model, including precision, recall, average precision, and image count. While these metrics are useful, they do not constitute a confusion matrix. Unfortunately, the confusion matrix is not directly provided in the Custom Vision portal. User's image

    The confusion matrix is a table that shows the number of true positives, true negatives, false positives, and false negatives for each class in your model. It is used to evaluate the performance of a classification model.

    I hope you understand. Thank you.


    Please don't forget to click Accept Answer and Yes for was this answer helpful.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.