Custom Vision's iteration performance with different values between user interface and web API

Luiz Ventura 0 Reputation points
2024-05-20T17:09:41.88+00:00

Hello,

I'm experiencing strange behaviors when consuming the Custom Vision API.

When checking the iteration performance inside the custom vision user interface, I have the following values:User's image

But when getting the same iteration performance via API, I have the following values:User's image

As you can see, only the "Average precision" is the same, the other 2 values are very different. Can you help me to understand what is happening here?

Thanks in advance.

Luiz

Azure AI Custom Vision
Azure AI Custom Vision
An Azure artificial intelligence service and end-to-end platform for applying computer vision to specific domains.
227 questions
{count} votes

1 answer

Sort by: Most helpful
  1. santoshkc 5,335 Reputation points Microsoft Vendor
    2024-05-21T06:01:12.07+00:00

    Hi @Luiz Ventura,

    Thank you for reaching out to Microsoft Q&A forum!

    It's not uncommon to see differences between the performance values displayed in the Custom Vision user interface and those returned by the API. This can happen due to a variety of reasons, such as caching, aggregation, or differences in the way the values are calculated.

    In your case, the precision and recall values are significantly different between the user interface and the API. This could be due to differences in the way the values are calculated. The user interface may be using a different evaluation metric or threshold for calculating precision and recall than the API.

    I hope you understand. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful.