VisualFeatures.Tags tag hierarcy & list of tags

Zeemage Support 0 Reputation points
2025-01-20T14:50:03.7233333+00:00

At the moment we are developing product using on Microsoft AI Vision Imageanalysis with VisualFeatures.Tags options.

We are testing Azure image analysis, i.e. images are analysed for basic tags (Person, vehicle, animal/mammal, bird., fire) User can define action based on selected Tags (notification). We have noticed that accuracy on deeper level makes no sense (e.g. deer/man, truck) as accuracy is nor sufficient. Issue though is that sometimes Tag analysis results in lower level tag without logical higher level (e.g. deer but no animal/mammal, same for horse), car but not vehicle. Of course We would value also exact tagging of animals for different species, but that will not function with sufficient accuracy (e.g. Deer is often horse etc.)

I.e. we need to use core/higher level tag,. There is though issue, system can state tag of horse or deer without stating animal or mammal, or car without stating vehicle. I need to understand is there possibility to have add hierarcy on tags, or minimum have full list of all alternative tags to build such our selves.

Is there proper documentation with e.g. Tags analysed

i.e. Hierarcy of tags, list of tags, documentation (VisualFeatures.Tags)

Azure AI Custom Vision
Azure AI Custom Vision
An Azure artificial intelligence service and end-to-end platform for applying computer vision to specific domains.
266 questions
Azure Startups
Azure Startups
Azure: A cloud computing platform and infrastructure for building, deploying and managing applications and services through a worldwide network of Microsoft-managed datacenters.Startups: Companies that are in their initial stages of business and typically developing a business model and seeking financing.
576 questions
{count} votes

1 answer

Sort by: Most helpful
  1. santoshkc 12,340 Reputation points Microsoft Vendor
    2025-01-21T12:14:48.1866667+00:00

    Hi @Zeemage Support,

    Thank you for reaching out to Microsoft Q&A forum!

    Azure Image Analysis provides tags for objects, animals, scenes, and actions in images, but these tags don’t follow a hierarchy. For example, you might see “deer” as a tag without also getting “animal” or “mammal.” Similarly, “car” might appear without “vehicle.”

    If you need structured categories, Azure offers the Image Categorization feature. This uses a fixed hierarchy of 86 categories, which can help group images into broader, parent-child categories. However, this taxonomy is limited and may not cover all your needs.

    Since tags don’t have built-in relationships, you can create your own hierarchy by mapping tags like “deer” to broader terms like “animal.” This custom mapping would help you maintain logical groupings for better accuracy and user actions.

    For more details, refer to the Tagging Images and Image Categorization documentation.

    I hope you understand! Thank you.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.