RubricBasedEvaluatorDefinition interface

Package:

@azure/ai-projects

Rubric-based evaluator definition — stores dimensions produced by the generate API. Used for both quality and safety evaluators.

Extends

EvaluatorDefinition

Properties

dimensions	The set of dimensions — the scoring blueprint used by the LLM judge. Quality evaluators include a non-editable residual dimension with id 'general_quality' (always_applicable: true); safety evaluators include 'general_policy_compliance'. Both use the same Dimension structure.
pass_threshold	Pass/fail threshold for the aggregate rubric score, on the same normalized 0.0-1.0 scale as the emitted score. When the runtime weighted average meets or exceeds this value, the result is pass. Defaults to 0.5 (equivalent to a raw 1-5 weighted average of 3.0). The 'any dimension scored 1 → fail' rule still applies regardless of this threshold.
type	The discriminator possible values: code, prompt, rubric

Inherited Properties

data_schema	The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.
init_parameters	The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.
metrics	List of output metrics produced by this evaluator

Property Details

dimensions

The set of dimensions — the scoring blueprint used by the LLM judge. Quality evaluators include a non-editable residual dimension with id 'general_quality' (always_applicable: true); safety evaluators include 'general_policy_compliance'. Both use the same Dimension structure.

dimensions: Dimension[]

Property Value

Dimension[]

pass_threshold

Pass/fail threshold for the aggregate rubric score, on the same normalized 0.0-1.0 scale as the emitted score. When the runtime weighted average meets or exceeds this value, the result is pass. Defaults to 0.5 (equivalent to a raw 1-5 weighted average of 3.0). The 'any dimension scored 1 → fail' rule still applies regardless of this threshold.

pass_threshold?: number

Property Value

number

type

The discriminator possible values: code, prompt, rubric

type: "rubric"

Property Value

"rubric"

Inherited Property Details

data_schema

The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.

data_schema?: Record<string, unknown>

Property Value

Record<string, unknown>

Inherited From EvaluatorDefinition.data_schema

init_parameters

The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.

init_parameters?: Record<string, unknown>

Property Value

Record<string, unknown>

Inherited From EvaluatorDefinition.init_parameters

metrics

List of output metrics produced by this evaluator

metrics?: Record<string, EvaluatorMetric>

Property Value

Record<string, EvaluatorMetric>

Inherited From EvaluatorDefinition.metrics