Review AI generated content with validation station

Important

Some of the functionality described in this release plan has not been released. Delivery timelines may change and projected functionality may not be released (see Microsoft policy). Learn more: What's new and planned

Enabled for Public preview General availability
Admins, makers, marketers, or analysts, automatically May 2025 Jul 2025

Business value

AI prompts can generate content based on what makers have defined, though it might not always match end users' expectations. They can send feedback, which is used by the maker to provide a more accurate response.

Feature details

The human in the loop feature covers four aspects:

  • Providing feedback: Users and makers can provide feedback on AI prompts responses when it isn't accurate.
  • Getting notifications for reviews: Makers are notified when new feedback is available.
  • Listing reviews: Makers can review the feedback sent for a given AI prompt.
  • Few-shot learning: Makers can use the feedback received or create samples to drive the AI prompts' responses and increase accuracy.