Use generative answers with GPT-powered AI

Important

This content is archived and is not being updated. For the latest documentation, go to the Microsoft Copilot Studio overview. For the latest release plans, go to Dynamics 365, Power Platform, and Cloud for Industry release plans.

Enabled for Public preview General availability
Users by admins, makers, or analysts Apr 1, 2023 Oct 2, 2023

Business value

Use Generative Answers in Microsoft Copilot Studio to enhance your copilot responses with contextual answers from your website. By using generative Answers in Microsoft Copilot Studio, your copilot can find and present information from an external source even if you haven't created a topic for it.

Quickly create and deploy a functional bot, without having to first manually author multiple topics that may or may not cover all the questions your customers might end up asking. This massively reduces the time it can take to get a chatbot up and running.

Feature details

In 2023 release wave 2, the generative answers capability in Microsoft Copilot Studio will be entering general availability, with the following changes:

  • Improvements to answer quality and system performance
  • Removal of preview-program usage throttling
  • Official general availability support

Microsoft Copilot Studio uses an underlying natural language understanding model for understanding a copilot user's question and determining the right topic. Typically, you create multiple topics within a copilot to account for what a user might ask. Sometimes, however, a copliot user might ask a question for which there is no built topic.

When this happens, by default, the copilot prompts the user to rephrase their query. If, after two prompts, the copilot still can't determine the user's intent, the copilot escalates to a live agent through the system Escalate topic.

You can specify a system Fallback topic to customize the response and actions the copilot takes - but this isn't always helpful for the bot user.

The Generative Answers option in Microsoft Copilot Studio preview helps to solve that issue by connecting the natural language processing capabilities of Azure OpenAI, which includes the use of OpenAI GPT technology, with the AI already in Microsoft Copilot Studio (including transformer-based natural language understanding) to:

  • Understand a user's intent by parsing what they type, and determining what they're asking
  • Find, collate, and parse relevant information from a URL you specify
  • Create a plain language response and deliver that to the copilot user

In other words, if the copilot doesn't already have an answer to what the user is asking, it can get the information and create one on-the-fly.

In this General Availability Release, these data sources have also been marked GA:

  • Public web content via Bing Search
  • SharePoint/OneDrive documents
  • Custom Data (bring your own data source)
  • Bing Custom Search endpoint for more control over the sources used

Refer to the Boost conversations topic for how to set up and use Generative Answers, along with tips for getting the best from the AI.

Note

Geo-expansion will be through consent for geos outside US and EU.

Geographic areas

This feature will be released into the following Microsoft Azure geographic areas:

  • Switzerland
  • United States
  • Europe
  • Asia Pacific
  • United Kingdom
  • Australia
  • Brazil
  • Canada
  • India
  • Japan
  • France

See also

AI-based copilot authoring overview (docs)