AgentOptimizationJobs
Create an agent optimization job
Creates an optimization job and returns the queued job. Honors Operation-Id for idempotent retry. Clients poll the URL in Operation-Location by using the get operation.
标头参数
Operation-Id
string
Client-generated unique ID for idempotent retries. When absent, the server creates the job unconditionally.
查询参数
api-version
string
必需
The API version to use for this operation.
请求正文
The job to create.
id
string
必需
Server-assigned unique identifier.
result
AgentOptimizationJobResult
Partial or terminal result produced by an agent optimization job.
candidate_summary
AgentOptimizationResultCandidateSummary
Summary of candidates produced by an agent optimization job.
completed_candidate_count
integer
必需
Number of completed candidates. Does not include the baseline.
baseline_id
string
Candidate ID of the original baseline. Omitted until the baseline candidate is available.
best_id
string
Candidate ID of the highest-scoring candidate for evaluated jobs, or the selected transformed output for non-comparative jobs. Omitted until a candidate has been selected.
baseline_score
number
Normalized score of the baseline candidate from 0.0 to 1.0 for a comparatively evaluated job. Omitted otherwise and until baseline evaluation completes.
best_score
number
Best normalized score observed from 0.0 to 1.0 for a comparatively evaluated job. Omitted otherwise and until a candidate completes evaluation.
latest_promoted_candidate
AgentOptimizationCandidatePromotionInfo
Promotion metadata recorded for a candidate.
promoted_agent
AgentReference
必需
type
enum
必需
name
string
必需
The name of the agent.
version
string
The version identifier of the agent.
token_usage
AgentOptimizationJobTokenUsage[]
必需
Aggregate token usage per stage and model. Always present; empty array when no calls were measured.
latency_metrics
AgentOptimizationJobLatency[]
必需
Aggregate latency per stage and model. Always present; empty when no server-measured latency is available.
termination_reason
string | enum
Reason the optimization process ended. Early termination reasons still indicate a successful job; completed candidates remain available.
enum
status
string | enum
必需
Extensible status values shared by Foundry jobs.
enum
error
OpenAI.Error
misalignment
OpenAI.MisalignmentErrorDetailsResource
error_type
string | enum
enum
detailed_explanation
string
The public explanation for this block.
steer
OpenAI._MisalignmentSteer
message
string
必需
The public continuation instruction.
display_name
string
Human-readable label. Omitted when no label is needed; it has no uniqueness, routing, or idempotency semantics.
target_configuration
foundry_agent
Base target configuration for an optimization job.
foundry_agent
AgentOptimizationFoundryAgentTargetConfiguration
Identifies the Foundry agent that owns the configuration being optimized.
type
enum
必需
Foundry-agent target discriminator.
name
string
必需
Registered Foundry agent name.
version
string
Pinned agent version. Omitted to resolve and pin the latest version.
optimization_model_configuration
AgentOptimizationModelConfiguration
必需
Identifies a model used by an optimization or evaluation step.
model
string
必需
A non-empty Foundry model name or existing deployment name.
optimization_configuration
agent_optimization | prompt_optimization
必需
Base model for type-specific optimization configuration.
agent_optimization
AgentOptimizationConfiguration
Configuration for optimizing an agent for measured quality.
type
enum
必需
Optimization type discriminator.
goal
string | enum
Goal for an agent-optimization job.
enum
evaluation_configuration
AgentOptimizationEvaluationConfiguration
必需
Reusable quality-measurement configuration.
training_set
target_completion | user_conversation_simulation
必需
Base discriminated model for an optimization evaluation set.
target_completion
AgentOptimizationTargetCompletionEvaluationSet
Evaluation set containing independent single-turn inputs.
type
enum
必需
Target-completion set discriminator.
source
inline | dataset_reference
必需
Base source for a target-completion optimization evaluation set.
inline
AgentOptimizationTargetCompletionInlineDataSource
Supplies single-turn rows directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
AgentOptimizationTargetCompletionTestCase[]
必需
Target-completion test cases.
dataset_reference
AgentOptimizationTargetCompletionDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for target-completion evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
user_conversation_simulation
AgentOptimizationUserConversationSimulationEvaluationSet
Evaluation set containing scenarios for simulated conversations.
type
enum
必需
User-conversation-simulation set discriminator.
source
inline | dataset_reference
必需
Base source for a user-conversation-simulation optimization evaluation set.
inline
AgentOptimizationUserConversationSimulationInlineDataSource
Supplies Evals user-conversation simulation test cases directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
UserConversationSimulationTestCase[]
必需
Conversation test scenarios.
dataset_reference
AgentOptimizationUserConversationSimulationDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for user-conversation-simulation evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
default_simulation_configuration
UserConversationSimulationConfiguration
Configures the number, length, audio effects, and simulated user behavior of conversations.
max_num_turns
integer
Hard limit on turns in each conversation. When omitted, the service defaults to 20.
conversation_repetitions
integer
Number of independent conversation repetitions for each test case. Defaults to 1 when not specified at either the data-source or test-case level.
desired_num_turns
integer
Target number of turns in each conversation. The effective value cannot exceed the effective max_num_turns. When omitted, no target is set and the simulation model determines the conversation length dynamically from the scenario.
audio_effects
UserConversationSimulationAudioEffectsConfiguration
Configures effects applied to simulated conversation audio.
effects
UserConversationSimulationAudioEffect[]
Effects to apply to simulated audio.
volume_percentage
integer
Volume of the configured audio effects, as a percentage from 1 through 100. When omitted, the service defaults to 15.
user_behavior
UserConversationSimulationUserBehaviorConfiguration
Configures conversation behavior for the simulated user.
interruption
default
Configuration for simulated user interruption behavior.
default
UserConversationSimulationDefaultInterruptionConfiguration
Configures the default interruption behavior for the simulated user.
type
enum
必需
The interruption type, always default.
validation_set
target_completion | user_conversation_simulation
Base discriminated model for an optimization evaluation set.
target_completion
AgentOptimizationTargetCompletionEvaluationSet
Evaluation set containing independent single-turn inputs.
type
enum
必需
Target-completion set discriminator.
source
inline | dataset_reference
必需
Base source for a target-completion optimization evaluation set.
inline
AgentOptimizationTargetCompletionInlineDataSource
Supplies single-turn rows directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
AgentOptimizationTargetCompletionTestCase[]
必需
Target-completion test cases.
dataset_reference
AgentOptimizationTargetCompletionDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for target-completion evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
user_conversation_simulation
AgentOptimizationUserConversationSimulationEvaluationSet
Evaluation set containing scenarios for simulated conversations.
type
enum
必需
User-conversation-simulation set discriminator.
source
inline | dataset_reference
必需
Base source for a user-conversation-simulation optimization evaluation set.
inline
AgentOptimizationUserConversationSimulationInlineDataSource
Supplies Evals user-conversation simulation test cases directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
UserConversationSimulationTestCase[]
必需
Conversation test scenarios.
dataset_reference
AgentOptimizationUserConversationSimulationDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for user-conversation-simulation evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
default_simulation_configuration
UserConversationSimulationConfiguration
Configures the number, length, audio effects, and simulated user behavior of conversations.
max_num_turns
integer
Hard limit on turns in each conversation. When omitted, the service defaults to 20.
conversation_repetitions
integer
Number of independent conversation repetitions for each test case. Defaults to 1 when not specified at either the data-source or test-case level.
desired_num_turns
integer
Target number of turns in each conversation. The effective value cannot exceed the effective max_num_turns. When omitted, no target is set and the simulation model determines the conversation length dynamically from the scenario.
audio_effects
UserConversationSimulationAudioEffectsConfiguration
Configures effects applied to simulated conversation audio.
effects
UserConversationSimulationAudioEffect[]
Effects to apply to simulated audio.
volume_percentage
integer
Volume of the configured audio effects, as a percentage from 1 through 100. When omitted, the service defaults to 15.
user_behavior
UserConversationSimulationUserBehaviorConfiguration
Configures conversation behavior for the simulated user.
interruption
default
Configuration for simulated user interruption behavior.
default
UserConversationSimulationDefaultInterruptionConfiguration
Configures the default interruption behavior for the simulated user.
type
enum
必需
The interruption type, always default.
evaluators
AgentOptimizationEvaluator[]
必需
Evaluator references used to score candidate quality.
evaluation_model
EvaluationModelConfiguration
必需
Configures the model that plays the simulated user. This model is separate from the evaluated target.
model
string
必需
Model deployment that generates simulated user turns, in the format {connectionName}/modelDeploymentName.
sampling_params
ModelSamplingParams
Represents a set of parameters used to control the sampling behavior of a language model during text generation.
temperature
number
The temperature parameter for sampling. Defaults to 1.0.
top_p
number
The top-p parameter for nucleus sampling. Defaults to 1.0.
seed
integer
The random seed for reproducibility. Defaults to 42.
max_completion_tokens
integer
The maximum number of tokens allowed in the completion.
voice_model
azure-standard
Voice configuration used to convert text to speech for evaluation through the Voice Live endpoint.
azure-standard
EvaluationAzureStandardVoiceModelConfiguration
Configures an Azure standard neural voice used to convert text to speech for evaluation through the Voice Live endpoint.
type
enum
必需
The voice kind. Always azure-standard.
name
string
必需
The Azure neural voice name.
temperature
number
The synthesis temperature, from 0 to 1. When omitted, the service defaults to the underlying voice model's default temperature.
max_concurrent_agent_runs
integer
Maximum number of target-agent runs executed concurrently during each single-turn evaluation. If omitted, the service defaults to 1. Conversation evaluation supports only 1.
candidate_search_configuration
AgentOptimizationCandidateSearchConfiguration
必需
Candidate search settings.
max_candidates
integer
Maximum number of non-baseline candidates to fully evaluate. If omitted, the service defaults to 1.
baseline_agent_configuration
AgentOptimizationBaselineAgentConfiguration
Caller-supplied baseline agent values that cannot be resolved from the target agent.
system_prompt
string
Caller-supplied baseline system prompt. Omitted to resolve the baseline from the target; a prompt agent's stored definition is authoritative.
current_model
string
A non-empty Foundry model name or existing deployment name.
skills
AgentOptimizationSkill[]
Skills available for optimization. Omitted when no manual skill surface is supplied.
tools
OpenAI.ChatCompletionTool[]
Function tools available for optimization. Omitted when no manual tool surface is supplied. The optimizer may change function and argument descriptions while preserving names and parameter JSON Schema.
agent_optimization_space
AgentOptimizationSpace
必需
The agent attributes and alternative values available to an agent-optimization search.
target_attributes
TargetAttribute[]
Agent attributes the optimizer may change. If omitted, the service defaults to instructions.
model_search_space
AgentOptimizationModelName[]
Alternative model names or existing deployment names available when model is an optimization target.
prompt_optimization
PromptOptimizationConfiguration
Configuration for a one-shot prompt transformation without comparative evaluation.
type
enum
必需
Optimization type discriminator.
context
OptimizationContext[]
Context used to steer prompt optimization. Omitted when no context is supplied.
run_duration_ms
integer
必需
A duration encoded as an integer number of milliseconds.
warnings
string[]
Non-fatal warnings emitted during optimization. Omitted when no warnings were produced.
响应
The request has succeeded and a new resource has been created as a result.
标头
Operation-Location
string
必需
URL to poll for the job status.
Location
string
必需
URL of the created job resource.
正文
id
string
必需
Server-assigned unique identifier.
result
AgentOptimizationJobResult
Partial or terminal result produced by an agent optimization job.
candidate_summary
AgentOptimizationResultCandidateSummary
Summary of candidates produced by an agent optimization job.
completed_candidate_count
integer
必需
Number of completed candidates. Does not include the baseline.
baseline_id
string
Candidate ID of the original baseline. Omitted until the baseline candidate is available.
best_id
string
Candidate ID of the highest-scoring candidate for evaluated jobs, or the selected transformed output for non-comparative jobs. Omitted until a candidate has been selected.
baseline_score
number
Normalized score of the baseline candidate from 0.0 to 1.0 for a comparatively evaluated job. Omitted otherwise and until baseline evaluation completes.
best_score
number
Best normalized score observed from 0.0 to 1.0 for a comparatively evaluated job. Omitted otherwise and until a candidate completes evaluation.
latest_promoted_candidate
AgentOptimizationCandidatePromotionInfo
Promotion metadata recorded for a candidate.
promoted_agent
AgentReference
必需
type
enum
必需
name
string
必需
The name of the agent.
version
string
The version identifier of the agent.
token_usage
AgentOptimizationJobTokenUsage[]
必需
Aggregate token usage per stage and model. Always present; empty array when no calls were measured.
latency_metrics
AgentOptimizationJobLatency[]
必需
Aggregate latency per stage and model. Always present; empty when no server-measured latency is available.
termination_reason
string | enum
Reason the optimization process ended. Early termination reasons still indicate a successful job; completed candidates remain available.
enum
status
string | enum
必需
Extensible status values shared by Foundry jobs.
enum
error
OpenAI.Error
misalignment
OpenAI.MisalignmentErrorDetailsResource
error_type
string | enum
enum
detailed_explanation
string
The public explanation for this block.
steer
OpenAI._MisalignmentSteer
message
string
必需
The public continuation instruction.
display_name
string
Human-readable label. Omitted when no label is needed; it has no uniqueness, routing, or idempotency semantics.
target_configuration
foundry_agent
Base target configuration for an optimization job.
foundry_agent
AgentOptimizationFoundryAgentTargetConfiguration
Identifies the Foundry agent that owns the configuration being optimized.
type
enum
必需
Foundry-agent target discriminator.
name
string
必需
Registered Foundry agent name.
version
string
Pinned agent version. Omitted to resolve and pin the latest version.
optimization_model_configuration
AgentOptimizationModelConfiguration
必需
Identifies a model used by an optimization or evaluation step.
model
string
必需
A non-empty Foundry model name or existing deployment name.
optimization_configuration
agent_optimization | prompt_optimization
必需
Base model for type-specific optimization configuration.
agent_optimization
AgentOptimizationConfiguration
Configuration for optimizing an agent for measured quality.
type
enum
必需
Optimization type discriminator.
goal
string | enum
Goal for an agent-optimization job.
enum
evaluation_configuration
AgentOptimizationEvaluationConfiguration
必需
Reusable quality-measurement configuration.
training_set
target_completion | user_conversation_simulation
必需
Base discriminated model for an optimization evaluation set.
target_completion
AgentOptimizationTargetCompletionEvaluationSet
Evaluation set containing independent single-turn inputs.
type
enum
必需
Target-completion set discriminator.
source
inline | dataset_reference
必需
Base source for a target-completion optimization evaluation set.
inline
AgentOptimizationTargetCompletionInlineDataSource
Supplies single-turn rows directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
AgentOptimizationTargetCompletionTestCase[]
必需
Target-completion test cases.
dataset_reference
AgentOptimizationTargetCompletionDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for target-completion evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
user_conversation_simulation
AgentOptimizationUserConversationSimulationEvaluationSet
Evaluation set containing scenarios for simulated conversations.
type
enum
必需
User-conversation-simulation set discriminator.
source
inline | dataset_reference
必需
Base source for a user-conversation-simulation optimization evaluation set.
inline
AgentOptimizationUserConversationSimulationInlineDataSource
Supplies Evals user-conversation simulation test cases directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
UserConversationSimulationTestCase[]
必需
Conversation test scenarios.
dataset_reference
AgentOptimizationUserConversationSimulationDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for user-conversation-simulation evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
default_simulation_configuration
UserConversationSimulationConfiguration
Configures the number, length, audio effects, and simulated user behavior of conversations.
max_num_turns
integer
Hard limit on turns in each conversation. When omitted, the service defaults to 20.
conversation_repetitions
integer
Number of independent conversation repetitions for each test case. Defaults to 1 when not specified at either the data-source or test-case level.
desired_num_turns
integer
Target number of turns in each conversation. The effective value cannot exceed the effective max_num_turns. When omitted, no target is set and the simulation model determines the conversation length dynamically from the scenario.
audio_effects
UserConversationSimulationAudioEffectsConfiguration
Configures effects applied to simulated conversation audio.
effects
UserConversationSimulationAudioEffect[]
Effects to apply to simulated audio.
volume_percentage
integer
Volume of the configured audio effects, as a percentage from 1 through 100. When omitted, the service defaults to 15.
user_behavior
UserConversationSimulationUserBehaviorConfiguration
Configures conversation behavior for the simulated user.
interruption
default
Configuration for simulated user interruption behavior.
default
UserConversationSimulationDefaultInterruptionConfiguration
Configures the default interruption behavior for the simulated user.
type
enum
必需
The interruption type, always default.
validation_set
target_completion | user_conversation_simulation
Base discriminated model for an optimization evaluation set.
target_completion
AgentOptimizationTargetCompletionEvaluationSet
Evaluation set containing independent single-turn inputs.
type
enum
必需
Target-completion set discriminator.
source
inline | dataset_reference
必需
Base source for a target-completion optimization evaluation set.
inline
AgentOptimizationTargetCompletionInlineDataSource
Supplies single-turn rows directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
AgentOptimizationTargetCompletionTestCase[]
必需
Target-completion test cases.
dataset_reference
AgentOptimizationTargetCompletionDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for target-completion evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
user_conversation_simulation
AgentOptimizationUserConversationSimulationEvaluationSet
Evaluation set containing scenarios for simulated conversations.
type
enum
必需
User-conversation-simulation set discriminator.
source
inline | dataset_reference
必需
Base source for a user-conversation-simulation optimization evaluation set.
inline
AgentOptimizationUserConversationSimulationInlineDataSource
Supplies Evals user-conversation simulation test cases directly in the optimization request.
type
enum
必需
Inline source discriminator.
test_cases
UserConversationSimulationTestCase[]
必需
Conversation test scenarios.
dataset_reference
AgentOptimizationUserConversationSimulationDatasetReferenceDataSource
References an explicitly versioned registered Foundry dataset for user-conversation-simulation evaluation.
type
enum
必需
Registered dataset source discriminator.
name
string
必需
Registered dataset name.
version
string
必需
Registered dataset version.
default_simulation_configuration
UserConversationSimulationConfiguration
Configures the number, length, audio effects, and simulated user behavior of conversations.
max_num_turns
integer
Hard limit on turns in each conversation. When omitted, the service defaults to 20.
conversation_repetitions
integer
Number of independent conversation repetitions for each test case. Defaults to 1 when not specified at either the data-source or test-case level.
desired_num_turns
integer
Target number of turns in each conversation. The effective value cannot exceed the effective max_num_turns. When omitted, no target is set and the simulation model determines the conversation length dynamically from the scenario.
audio_effects
UserConversationSimulationAudioEffectsConfiguration
Configures effects applied to simulated conversation audio.
effects
UserConversationSimulationAudioEffect[]
Effects to apply to simulated audio.
volume_percentage
integer
Volume of the configured audio effects, as a percentage from 1 through 100. When omitted, the service defaults to 15.
user_behavior
UserConversationSimulationUserBehaviorConfiguration
Configures conversation behavior for the simulated user.
interruption
default
Configuration for simulated user interruption behavior.
default
UserConversationSimulationDefaultInterruptionConfiguration
Configures the default interruption behavior for the simulated user.
type
enum
必需
The interruption type, always default.
evaluators
AgentOptimizationEvaluator[]
必需
Evaluator references used to score candidate quality.
evaluation_model
EvaluationModelConfiguration
必需
Configures the model that plays the simulated user. This model is separate from the evaluated target.
model
string
必需
Model deployment that generates simulated user turns, in the format {connectionName}/modelDeploymentName.
sampling_params
ModelSamplingParams
Represents a set of parameters used to control the sampling behavior of a language model during text generation.
temperature
number
The temperature parameter for sampling. Defaults to 1.0.
top_p
number
The top-p parameter for nucleus sampling. Defaults to 1.0.
seed
integer
The random seed for reproducibility. Defaults to 42.
max_completion_tokens
integer
The maximum number of tokens allowed in the completion.
voice_model
azure-standard
Voice configuration used to convert text to speech for evaluation through the Voice Live endpoint.
azure-standard
EvaluationAzureStandardVoiceModelConfiguration
Configures an Azure standard neural voice used to convert text to speech for evaluation through the Voice Live endpoint.
type
enum
必需
The voice kind. Always azure-standard.
name
string
必需
The Azure neural voice name.
temperature
number
The synthesis temperature, from 0 to 1. When omitted, the service defaults to the underlying voice model's default temperature.
max_concurrent_agent_runs
integer
Maximum number of target-agent runs executed concurrently during each single-turn evaluation. If omitted, the service defaults to 1. Conversation evaluation supports only 1.
candidate_search_configuration
AgentOptimizationCandidateSearchConfiguration
必需
Candidate search settings.
max_candidates
integer
Maximum number of non-baseline candidates to fully evaluate. If omitted, the service defaults to 1.
baseline_agent_configuration
AgentOptimizationBaselineAgentConfiguration
Caller-supplied baseline agent values that cannot be resolved from the target agent.
system_prompt
string
Caller-supplied baseline system prompt. Omitted to resolve the baseline from the target; a prompt agent's stored definition is authoritative.
current_model
string
A non-empty Foundry model name or existing deployment name.
skills
AgentOptimizationSkill[]
Skills available for optimization. Omitted when no manual skill surface is supplied.
tools
OpenAI.ChatCompletionTool[]
Function tools available for optimization. Omitted when no manual tool surface is supplied. The optimizer may change function and argument descriptions while preserving names and parameter JSON Schema.
agent_optimization_space
AgentOptimizationSpace
必需
The agent attributes and alternative values available to an agent-optimization search.
target_attributes
TargetAttribute[]
Agent attributes the optimizer may change. If omitted, the service defaults to instructions.
model_search_space
AgentOptimizationModelName[]
Alternative model names or existing deployment names available when model is an optimization target.
prompt_optimization
PromptOptimizationConfiguration
Configuration for a one-shot prompt transformation without comparative evaluation.
type
enum
必需
Optimization type discriminator.
context
OptimizationContext[]
Context used to steer prompt optimization. Omitted when no context is supplied.
run_duration_ms
integer
必需
A duration encoded as an integer number of milliseconds.
warnings
string[]
Non-fatal warnings emitted during optimization. Omitted when no warnings were produced.
请求
POST /agent_optimization_jobs HTTP/1.1
响应
Status: 201
Content-Type: application/json
Status: 4XX
Content-Type: application/json
Status: 5XX
Content-Type: application/json