CodeBasedEvaluatorDefinition interface
Code-based evaluator definition using python code
- Extends
Properties
| code_text | Inline code text for the evaluator |
| type | The discriminator possible values: code, prompt |
Inherited Properties
| data_schema | The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required. |
| init_parameters | The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required. |
| metrics | List of output metrics produced by this evaluator |
Property Details
code_text
Inline code text for the evaluator
code_text: string
Property Value
string
type
The discriminator possible values: code, prompt
type: "code"
Property Value
"code"
Inherited Property Details
data_schema
The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.
data_schema?: unknown
Property Value
unknown
Inherited From EvaluatorDefinition.data_schema
init_parameters
The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.
init_parameters?: unknown
Property Value
unknown
Inherited From EvaluatorDefinition.init_parameters
metrics
List of output metrics produced by this evaluator
metrics?: Record<string, EvaluatorMetric>
Property Value
Record<string, EvaluatorMetric>
Inherited From EvaluatorDefinition.metrics