Dimension interface

A single dimension — one independent, measurable quality dimension within a rubric evaluator's scoring blueprint.

Properties

always_applicable

When true, the LLM judge always scores this dimension regardless of relevance (skips applicability assessment). The service-generated general quality/policy dimension has this set to true and is non-editable. Users may set this on their own custom dimensions.

description

What this dimension measures (e.g., 'Correctly identifies the user's reservation intent and pursues the appropriate workflow').

id

Stable identifier for this dimension (snake_case, e.g., correct_resolution). Required. Provided by the user when manually creating a rubric evaluator or during human-in-the-loop review of a generated set; the generation pipeline produces an initial value the user can edit. Editable when saving new versions.

weight

Relative weight of this dimension (1-10). The generation pipeline assigns exactly one dimension weight 8-10; all others use 1-6. User edits are not constrained by this heuristic.

Property Details

always_applicable

When true, the LLM judge always scores this dimension regardless of relevance (skips applicability assessment). The service-generated general quality/policy dimension has this set to true and is non-editable. Users may set this on their own custom dimensions.

always_applicable?: boolean

Property Value

boolean

description

What this dimension measures (e.g., 'Correctly identifies the user's reservation intent and pursues the appropriate workflow').

description: string

Property Value

string

id

Stable identifier for this dimension (snake_case, e.g., correct_resolution). Required. Provided by the user when manually creating a rubric evaluator or during human-in-the-loop review of a generated set; the generation pipeline produces an initial value the user can edit. Editable when saving new versions.

id: string

Property Value

string

weight

Relative weight of this dimension (1-10). The generation pipeline assigns exactly one dimension weight 8-10; all others use 1-6. User edits are not constrained by this heuristic.

weight: number

Property Value

number