What's new in Azure AI Content Safety
Learn what's new in the service. These items might be release notes, videos, blog posts, and other types of information. Bookmark this page to stay up to date with new features, enhancements, fixes, and documentation updates.
July 2024
Custom categories (standard) API public preview
The custom categories (standard) API lets you create and train your own custom content categories and scan text for matches. See Custom categories to learn more.
May 2024
Custom categories (rapid) API public preview
The custom categories (rapid) API lets you quickly define emerging harmful content patterns and scan text and images for matches. See Custom categories to learn more.
March 2024
Prompt Shields public preview
Previously known as Jailbreak risk detection, this updated feature detects prompt attacks, in which users deliberately exploit system vulnerabilities to elicit unauthorized behavior from large language model. Prompt Shields analyzes both direct user prompt attacks and indirect attacks which are embedded in input documents or images. See Prompt Shields to learn more.
Groundedness detection public preview
The Groundedness detection API detects whether the text responses of large language models (LLMs) are grounded in the source materials provided by the users. Ungroundedness describes instances where the LLMs produce information that is non-factual or inaccurate according to what was present in the source materials. See Groundedness detection to learn more.
January 2024
Content Safety SDK GA
The Azure AI Content Safety service is now generally available through the following client library SDKs:
- C#: Package | API reference | Samples | Quickstarts: Text, Image
- Python: Package | API reference | Samples | Quickstarts: Text, Image
- Java: Package | API reference | Samples | Quickstarts: Text, Image
- JavaScript: Package | API reference | Samples | Quickstarts: Text, Image
Important
The public preview versions of the Azure AI Content Safety SDKs will be deprecated by March 31, 2024. Please update your applications to use the GA versions.
November 2023
Jailbreak risk and protected material detection (preview)
The new Jailbreak risk detection and protected material detection APIs let you mitigate some of the risks when using generative AI.
- Jailbreak risk detection scans text for the risk of a jailbreak attack on a Large Language Model. Quickstart
- Protected material text detection scans AI-generated text for known text content (for example, song lyrics, articles, recipes, selected web content). Quickstart
Jailbreak risk and protected material detection are only available in select regions. See Region availability.
October 2023
Azure AI Content Safety is generally available (GA)
The Azure AI Content Safety service is now generally available as a cloud service.
- The service is available in many more Azure regions. See the Overview for a list.
- The return formats of the Analyze APIs have changed. See the Quickstarts for the latest examples.
- The names and return formats of several other APIs have changed. See the Migration guide for a full list of breaking changes. Other guides and quickstarts now reflect the GA version.
Azure AI Content Safety Java and JavaScript SDKs
The Azure AI Content Safety service is now available through Java and JavaScript SDKs. The SDKs are available on Maven and npm respectively. Follow a quickstart to get started.
July 2023
Azure AI Content Safety C# SDK
The Azure AI Content Safety service is now available through a C# SDK. The SDK is available on NuGet. Follow a quickstart to get started.
May 2023
Azure AI Content Safety public preview
Azure AI Content Safety detects material that is potentially offensive, risky, or otherwise undesirable. This service offers state-of-the-art text and image models that detect problematic content. Azure AI Content Safety helps make applications and services safer from harmful user-generated and AI-generated content. Follow a quickstart to get started.