Share via


Analyze quality of responses that use generative AI

Important

Some of the functionality described in this release plan has not been released. Delivery timelines may change and projected functionality may not be released (see Microsoft policy). Learn more: What's new and planned

Enabled for Public preview General availability
Admins, makers, marketers, or analysts, automatically Jun 17, 2025 Sep 2025

Business value

Get insights into the quality of your knowledge sources and how well the agent responds to different types of questions. With this information, you can better serve your agent users.

Feature details

Quality of response analyzes a sample set of successfully answered generative AI questions to provide insights about the quality of generative AI responses.

The feature uses AI to check the relevance, completeness, and grounding of each response in the sample set. It assigns a quality score for each response. The feature uses the quality score to classify each response as having good or poor quality.

Makers see a visual indicator that shows the breakdown of answered generative AI questions between good and poor quality. Makers can view the reasons for poor quality responses. They can see if the response isn't fully relevant, if the response is incomplete, or if the response isn't fully grounded.

Geographic areas

Visit the Explore Feature Geography report for Microsoft Azure areas where this feature is planned or available.

Language availability

Visit the Explore Feature Language report for information on this feature's availability.