Share via


EvaluatorDefinition interface

Base evaluator configuration with discriminator

Properties

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

metrics

List of output metrics produced by this evaluator

type

The discriminator possible values: code, prompt

Property Details

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

data_schema?: unknown

Property Value

unknown

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

init_parameters?: unknown

Property Value

unknown

metrics

List of output metrics produced by this evaluator

metrics?: Record<string, EvaluatorMetric>

Property Value

Record<string, EvaluatorMetric>

type

The discriminator possible values: code, prompt

type: EvaluatorDefinitionType

Property Value