Why Image moderation racy scores is 93% in a total no racy pictures?

Riccardo Perelli
156
Reputation points
Hi,
i'm working on a content moderation pipeline for my company, i'm testing the Azure Content moderator, Specifically, the Image Moderator.
All seemed to be fine until i tried to moderate "people-on-the-beach" pictures.
you can see the pics attached.
All of this three images return a racy score in the range 90%-94%, clearly these aren't racy images, i wonder why the content moderator is doing this.
Some suggestion:
- Can be a image size problem? maybe they are of a wrong dimension that confuse the models?
- Extension problem? what takes to analyze jpg or png images? the analysis change?
- Color problem? maybe the color confuse the model? B&W images can be the solution?
I hope you can help me, and if you want, you can suggest me some alternatives in order to do image moderation?
TY
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,631 questions
Community Center | Not monitored
46,253 questions
Sign in to answer