Language

ProjectsAgentsModelFactory.AgentOptimizationEvaluationConfiguration Method

Definition

Reusable quality-measurement configuration.

public static Azure.AI.Projects.Agents.AgentOptimizationEvaluationConfiguration AgentOptimizationEvaluationConfiguration(Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet trainingSet = default, Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet validationSet = default, System.Collections.Generic.IEnumerable<Azure.AI.Projects.Agents.AgentOptimizationEvaluator> evaluators = default, Azure.AI.Projects.Agents.EvaluationModelConfiguration evaluationModel = default, int? maxConcurrentAgentRuns = default);
static member AgentOptimizationEvaluationConfiguration : Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet * Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet * seq<Azure.AI.Projects.Agents.AgentOptimizationEvaluator> * Azure.AI.Projects.Agents.EvaluationModelConfiguration * Nullable<int> -> Azure.AI.Projects.Agents.AgentOptimizationEvaluationConfiguration
Public Shared Function AgentOptimizationEvaluationConfiguration (Optional trainingSet As AgentOptimizationEvaluationSet = Nothing, Optional validationSet As AgentOptimizationEvaluationSet = Nothing, Optional evaluators As IEnumerable(Of AgentOptimizationEvaluator) = Nothing, Optional evaluationModel As EvaluationModelConfiguration = Nothing, Optional maxConcurrentAgentRuns As Nullable(Of Integer) = Nothing) As AgentOptimizationEvaluationConfiguration

Parameters

trainingSet
AgentOptimizationEvaluationSet

Evaluation set used to guide the optimization search. Inline data supports up to 2,000 test cases when a separate validation set is supplied; otherwise it is also used for validation and is limited to 500.

validationSet
AgentOptimizationEvaluationSet

Held-out evaluation set used for full candidate evaluation, limited to 500 inline test cases. The training set is reused and subject to the same 500-test-case validation limit when omitted.

evaluators
IEnumerable<AgentOptimizationEvaluator>

Evaluator references used to score candidate quality.

evaluationModel
EvaluationModelConfiguration

Model configuration used by model-based evaluators and conversation simulation.

maxConcurrentAgentRuns
Nullable<Int32>

Maximum number of target-agent runs executed concurrently during each single-turn evaluation. If omitted, the service defaults to 1. Conversation evaluation supports only 1.

Returns

A new AgentOptimizationEvaluationConfiguration instance for mocking.

Applies to