Exercise - Evaluate and publish a support policy agent

Completed

In this exercise, you create the Contoso Policy Agent, a support policy agent, and a specialized escalation agent. You connect the agents, evaluate delegation with a structured set of test conversations, correct one deliberate instruction defect, publish the main agent to Microsoft Teams, and validate its behavior as a published user.

This exercise takes approximately 55 minutes to complete.

Before you start

Use an environment with the Evaluate tab available and approved Copilot Credit capacity for building, testing, and evaluating both agents. You also need permission to publish and install the main agent in Microsoft Teams, or help from an administrator who can approve it.

The exercise uses Microsoft Teams only. The publishing unit also explains Microsoft Copilot availability, but this exercise doesn't require publishing to or validating in Microsoft Copilot.

Validate the exercise results

Use these checks as you follow the linked exercise:

  • Record the baseline you observe: The conflicting instruction is a routing defect to investigate, but it doesn't guarantee a particular response or failed score. Record whether the main agent delegates or blocks the escalation. Don't require extension 4357 in the baseline response. That contact is supplied by the specialist.
  • Verify delegation after the correction: Check that the escalation response includes extension 4357, and use Preview's activity trace or Monitor session details to confirm that the specialist is invoked. The extension number alone isn't proof of delegation.
  • Compare behavior, not just scores: Review all four conversations after the instruction change. Confirm that routine questions stay with the main agent, out-of-scope requests are declined, and escalation requests reach the specialist. General quality scores can vary between runs. They support, but don't replace, these checks.