EvaluatorGenerationInputs Class

Definition

Caller-supplied inputs for an evaluator generation job.

public class EvaluatorGenerationInputs : System.ClientModel.Primitives.IJsonModel<Azure.AI.Projects.EvaluatorGenerationInputs>, System.ClientModel.Primitives.IPersistableModel<Azure.AI.Projects.EvaluatorGenerationInputs>
type EvaluatorGenerationInputs = class
    interface IJsonModel<EvaluatorGenerationInputs>
    interface IPersistableModel<EvaluatorGenerationInputs>
Public Class EvaluatorGenerationInputs
Implements IJsonModel(Of EvaluatorGenerationInputs), IPersistableModel(Of EvaluatorGenerationInputs)
Inheritance
EvaluatorGenerationInputs
Implements

Constructors

Name Description
EvaluatorGenerationInputs(IEnumerable<EvaluatorGenerationJobSource>, String, String)

Initializes a new instance of EvaluatorGenerationInputs.

Properties

Name Description
EvaluatorDescription

Optional human-friendly description for the resulting evaluator. Surfaced as EvaluatorVersion.description on the persisted evaluator. Typically collected from the UI alongside evaluator_display_name. The evaluator_ prefix disambiguates this from any other description fields on related models.

EvaluatorDisplayName

Optional human-friendly display name for the resulting evaluator. Surfaced as EvaluatorVersion.display_name on the persisted evaluator. When omitted, the service uses evaluator_name as the display name. The evaluator_ prefix disambiguates this from the immutable evaluator_name identifier.

EvaluatorName

The evaluator name (immutable identifier). 1-256 characters; allowed characters are ASCII letters, digits, underscore (_), period (.), tilde (~), and hyphen (-). The prefix builtin. is reserved for system-managed evaluators and is rejected by the service. If an evaluator with this name already exists in the project (and is rubric-subtype), the service creates a new version under the same name and uses the prior version's dimensions as context for incremental improvement (foundation of the post-//build adaptive loop). Old versions remain queryable via get_version(name, version). If the existing evaluator is not a rubric-subtype evaluator (built-in, prompt-based, code-based), the request is rejected with 400 Bad Request.

Model

The LLM model to use for rubric generation (e.g., 'gpt-4o'). Required — users must provide their own model rather than relying on service-owned capacity.

Sources

Source materials for generation — agent descriptions, prompts, traces, or datasets. Each entry is an EvaluatorGenerationJobSource variant discriminated by type.

Methods

Name Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name Description
IJsonModel<EvaluatorGenerationInputs>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<EvaluatorGenerationInputs>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<EvaluatorGenerationInputs>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<EvaluatorGenerationInputs>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<EvaluatorGenerationInputs>.Write(ModelReaderWriterOptions)

Applies to