Muistiinpano
Tämän sivun käyttö edellyttää valtuutusta. Voit yrittää kirjautua sisään tai vaihtaa hakemistoa.
Tämän sivun käyttö edellyttää valtuutusta. Voit yrittää vaihtaa hakemistoa.
FoundryEvals connects the Agent Framework evaluation APIs to Microsoft Foundry's managed evaluation service. It provides quality, safety, tool-use, agent-behavior, and rubric evaluators, with stored reports available in the Foundry portal.
For EvalItem, local checks, custom evaluators, and conversation split strategies, see Agent evaluation.
Prerequisites
- A Microsoft Foundry project and model deployment.
- A project-scoped Foundry endpoint.
- Permission to submit evaluations and read reports.
Evaluate responses or test queries
Configure FoundryEvals, then evaluate responses already generated or let EvaluateAsync run the agent for each query.
The .NET samples also demonstrate Foundry rubric evaluators and per-dimension quality gates.
Evaluate an agent
Pass existing responses or test queries to evaluate_agent(). Results include pass/fail counts and the Foundry report URL.
Evaluate existing responses and traces
evaluate_traces(...) requires the evaluator model deployment explicitly:
import os
from agent_framework.foundry import FoundryEvals, evaluate_traces
results = await evaluate_traces(
response_ids=response_ids,
evaluators=[FoundryEvals.RELEVANCE, FoundryEvals.GROUNDEDNESS],
client=chat_client,
model=os.environ["FOUNDRY_MODEL"],
)
See the trace evaluation sample for response-ID and agent-trace patterns.
Additional samples cover tool-call evaluation, multi-turn evaluation, workflow evaluation, mixed providers, and custom Foundry rubrics.
Note
Microsoft Foundry evaluation integration isn't currently available for Agent Framework Go. See the Agent Framework Go repository for the latest status.
Quality gates
Pin datasets, model deployments, evaluator versions, and rubric versions when results must be comparable across runs. Use result assertion helpers to fail CI when required metrics regress.