Hi @Shelby Joyner,
Thank you for your question.
Azure Content Moderator is an AI service that lets you handle content that is potentially offensive, risky, or otherwise undesirable. The API group of Azure Text moderation Scans text for offensive content based on these categories: sexually explicit or suggestive content, profanity, and personal data. The Azure Content Moderator service uses machine learning models to classify text into potentially offensive categories. The models are trained on a large dataset of labeled text examples, which includes a mix of public and private data.
The Content Moderator service includes a built-in list of profane terms in various languages, which is used to detect profanity in text content. However, the list is not publicly available. The API detects any profane terms in any of the supported languages, those terms are included in the response. The response also contains their location (Index
) in the original text. The ListId
in the following sample JSON refers to terms found in custom term lists if available.
"Terms": [
{
"Index": 118,
"OriginalIndex": 118,
"ListId": 0,
"Term": "<offensive word>"
}
For more info see: content-moderator and text moderation concepts.
I hope you understand. And, if you have any further query do let us know.
If this answers your query, do click Accept Answer
and Yes
for was this answer helpful.