Why Image moderation racy scores is 93% in a total no racy pictures?

Riccardo Perelli 156 Reputation points
2022-04-15T15:42:15.77+00:00

Hi,

i'm working on a content moderation pipeline for my company, i'm testing the Azure Content moderator, Specifically, the Image Moderator.

All seemed to be fine until i tried to moderate "people-on-the-beach" pictures.
you can see the pics attached.
193473-persone-al-mare4.jpg
193523-person-mare2.jpg
193474-vivere-al-mare.jpg

All of this three images return a racy score in the range 90%-94%, clearly these aren't racy images, i wonder why the content moderator is doing this.

Some suggestion:

  • Can be a image size problem? maybe they are of a wrong dimension that confuse the models?
  • Extension problem? what takes to analyze jpg or png images? the analysis change?
  • Color problem? maybe the color confuse the model? B&W images can be the solution?

I hope you can help me, and if you want, you can suggest me some alternatives in order to do image moderation?
TY

Not Monitored
Not Monitored
Tag not monitored by Microsoft.
36,086 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,386 questions
{count} votes