ProjectsAgentsModelFactory.AgentOptimizationEvaluationConfiguration Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Reusable quality-measurement configuration.
public static Azure.AI.Projects.Agents.AgentOptimizationEvaluationConfiguration AgentOptimizationEvaluationConfiguration(Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet trainingSet = default, Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet validationSet = default, System.Collections.Generic.IEnumerable<Azure.AI.Projects.Agents.AgentOptimizationEvaluator> evaluators = default, Azure.AI.Projects.Agents.EvaluationModelConfiguration evaluationModel = default, int? maxConcurrentAgentRuns = default);
static member AgentOptimizationEvaluationConfiguration : Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet * Azure.AI.Projects.Agents.AgentOptimizationEvaluationSet * seq<Azure.AI.Projects.Agents.AgentOptimizationEvaluator> * Azure.AI.Projects.Agents.EvaluationModelConfiguration * Nullable<int> -> Azure.AI.Projects.Agents.AgentOptimizationEvaluationConfiguration
Public Shared Function AgentOptimizationEvaluationConfiguration (Optional trainingSet As AgentOptimizationEvaluationSet = Nothing, Optional validationSet As AgentOptimizationEvaluationSet = Nothing, Optional evaluators As IEnumerable(Of AgentOptimizationEvaluator) = Nothing, Optional evaluationModel As EvaluationModelConfiguration = Nothing, Optional maxConcurrentAgentRuns As Nullable(Of Integer) = Nothing) As AgentOptimizationEvaluationConfiguration
Parameters
- trainingSet
- AgentOptimizationEvaluationSet
Evaluation set used to guide the optimization search. Inline data supports up to 2,000 test cases when a separate validation set is supplied; otherwise it is also used for validation and is limited to 500.
- validationSet
- AgentOptimizationEvaluationSet
Held-out evaluation set used for full candidate evaluation, limited to 500 inline test cases. The training set is reused and subject to the same 500-test-case validation limit when omitted.
- evaluators
- IEnumerable<AgentOptimizationEvaluator>
Evaluator references used to score candidate quality.
- evaluationModel
- EvaluationModelConfiguration
Model configuration used by model-based evaluators and conversation simulation.
Maximum number of target-agent runs executed concurrently during each single-turn evaluation. If omitted, the service defaults to 1. Conversation evaluation supports only 1.
Returns
A new AgentOptimizationEvaluationConfiguration instance for mocking.