Why Image moderation racy scores is 93% in a total no racy pictures?

Riccardo Perelli 151 Reputation points
2022-04-15T15:42:15.77+00:00

Hi,

i'm working on a content moderation pipeline for my company, i'm testing the Azure Content moderator, Specifically, the Image Moderator.

All seemed to be fine until i tried to moderate "people-on-the-beach" pictures.
you can see the pics attached.
193473-persone-al-mare4.jpg
193523-person-mare2.jpg
193474-vivere-al-mare.jpg

All of this three images return a racy score in the range 90%-94%, clearly these aren't racy images, i wonder why the content moderator is doing this.

Some suggestion:

  • Can be a image size problem? maybe they are of a wrong dimension that confuse the models?
  • Extension problem? what takes to analyze jpg or png images? the analysis change?
  • Color problem? maybe the color confuse the model? B&W images can be the solution?

I hope you can help me, and if you want, you can suggest me some alternatives in order to do image moderation?
TY

Azure Content Moderator
Azure Content Moderator
An Azure cognitive service that provides automated image, text, and video moderation.
35 questions
Azure Cognitive Services
Azure Cognitive Services
A group of Azure artificial intelligence services and cognitive APIs that help build intelligent apps.
1,141 questions
{count} votes