EvaluatorDefinition interface
Base evaluator configuration with discriminator
Properties
| data_schema | The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required. |
| init_parameters | The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required. |
| metrics | List of output metrics produced by this evaluator |
| type | The discriminator possible values: code, prompt |
Property Details
data_schema
The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.
data_schema?: unknown
Property Value
unknown
init_parameters
The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.
init_parameters?: unknown
Property Value
unknown
metrics
List of output metrics produced by this evaluator
metrics?: Record<string, EvaluatorMetric>
Property Value
Record<string, EvaluatorMetric>
type
The discriminator possible values: code, prompt
type: EvaluatorDefinitionType