Share via


PromptBasedEvaluatorDefinition interface

Prompt-based evaluator

Extends

Properties

prompt_text

The prompt text used for evaluation

type

The discriminator possible values: code, prompt

Inherited Properties

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

metrics

List of output metrics produced by this evaluator

Property Details

prompt_text

The prompt text used for evaluation

prompt_text: string

Property Value

string

type

The discriminator possible values: code, prompt

type: "prompt"

Property Value

"prompt"

Inherited Property Details

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

data_schema?: unknown

Property Value

unknown

Inherited From EvaluatorDefinition.data_schema

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

init_parameters?: unknown

Property Value

unknown

Inherited From EvaluatorDefinition.init_parameters

metrics

List of output metrics produced by this evaluator

metrics?: Record<string, EvaluatorMetric>

Property Value

Record<string, EvaluatorMetric>

Inherited From EvaluatorDefinition.metrics