Delen via


ContentFilterResultForPrompt Class

Definition

A content filter result associated with a single input prompt item into a generative AI system.

public class ContentFilterResultForPrompt : System.ClientModel.Primitives.IJsonModel<Azure.AI.OpenAI.ContentFilterResultForPrompt>, System.ClientModel.Primitives.IPersistableModel<Azure.AI.OpenAI.ContentFilterResultForPrompt>
type ContentFilterResultForPrompt = class
    interface IJsonModel<ContentFilterResultForPrompt>
    interface IPersistableModel<ContentFilterResultForPrompt>
Public Class ContentFilterResultForPrompt
Implements IJsonModel(Of ContentFilterResultForPrompt), IPersistableModel(Of ContentFilterResultForPrompt)
Inheritance
ContentFilterResultForPrompt
Implements

Properties

CustomBlocklists

A collection of binary filtering outcomes for configured custom blocklists.

Hate

A content filter category that can refer to any content that attacks or uses pejorative or discriminatory language with reference to a person or identity group based on certain differentiating attributes of these groups including but not limited to race, ethnicity, nationality, gender identity and expression, sexual orientation, religion, immigration status, ability status, personal appearance, and body size.

IndirectAttack

A detection result that describes attacks on systems powered by Generative AI models that can happen every time an application processes information that wasn’t directly authored by either the developer of the application or the user.

Jailbreak

A detection result that describes user prompt injection attacks, where malicious users deliberately exploit system vulnerabilities to elicit unauthorized behavior from the LLM. This could lead to inappropriate content generation or violations of system-imposed restrictions.

Profanity

A detection result that identifies whether crude, vulgar, or otherwise objection language is present in the content.

SelfHarm

A content filter category that describes language related to physical actions intended to purposely hurt, injure, damage one's body or kill oneself.

Sexual

A content filter category for language related to anatomical organs and genitals, romantic relationships, acts portrayed in erotic or affectionate terms, pregnancy, physical sexual acts, including those portrayed as an assault or a forced sexual violent act against one's will, prostitution, pornography, and abuse.

Violence

A content filter category for language related to physical actions intended to hurt, injure, damage, or kill someone or something; describes weapons, guns and related entities, such as manufactures, associations, legislation, and so on.

Explicit Interface Implementations

IJsonModel<ContentFilterResultForPrompt>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

IJsonModel<ContentFilterResultForPrompt>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

IPersistableModel<ContentFilterResultForPrompt>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

IPersistableModel<ContentFilterResultForPrompt>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

IPersistableModel<ContentFilterResultForPrompt>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

Applies to