Share via


EvaluatorDefinition interface

Base evaluator configuration with discriminator

Properties

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

metrics

List of output metrics produced by this evaluator

type

The discriminator possible values: code, prompt

Property Details

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

data_schema?: Record<string, unknown>

Property Value

Record<string, unknown>

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

init_parameters?: Record<string, unknown>

Property Value

Record<string, unknown>

metrics

List of output metrics produced by this evaluator

metrics?: Record<string, EvaluatorMetric>

Property Value

Record<string, EvaluatorMetric>

type

The discriminator possible values: code, prompt

type: EvaluatorDefinitionType

Property Value