View evaluation results for an agent (preview)

[This article is prerelease documentation and is subject to change.]

After you run an evaluation, review the results to see how well your agent performed across conversations. The results show quality scores and let you open individual conversations to see the agent's responses.

Important

View run results

To view run results:

  1. Open your agent in Copilot Studio.
  2. Select the Evaluate tab.
  3. Under recent results, select an evaluation with a prior test run to view its results.

The results show the following information:

  • Test run result: A table that shows each conversation with the number of messages between the user and the agent, and the general quality score. Select a conversation to see more details.

  • Evaluation summary: A summary of your overall evaluation across all test methods. It includes the following information:

    • Score: The overall score of conversations that passed the general quality test method.
    • Duration: The length of time it took to complete the evaluation.
    • Test cases: The number of test cases in your overall evaluation.
    • Data type: The type of test set. Only the Conversation data type is available.
    • User profile: The user profile that ran the evaluation.

Review a test case

To review a test case:

  1. On the run results page, select a conversation to expand its details.

  2. Review the Test case details:

    • User messages: The test messages sent to the agent.
    • Agent responses: The agent's actual responses.
    • General quality: How the responses scored on the test method, either Pass or Fail.

    Use this information to identify where your agent needs improvement.

Compare runs

Run the same evaluation multiple times to compare results and track progress:

  1. On the evaluation detail page, review the list of runs with their scores and timestamps.
  2. Compare scores across runs to see if your agent changes improved or degraded performance.
  3. Look for patterns. For example, if a category of conversations consistently scores low, that area might need more instructions or knowledge.

Export results

Export evaluation results for further analysis:

  1. On the run results page, select the three dots (…) > Export test results. You can also select a specific evaluation, and then select the three dots (…) > Export test results in the upper right corner.
  2. Download the results as a CSV file that includes all conversations, responses, and scores.

Act on results

Based on your evaluation results:

  • Last updated on