RubricGenerationInputQualityWarning interface

A non-fatal advisory produced during rubric evaluator generation when resolved inputs are technically valid but likely too weak to produce a high-quality rubric. Read-only; service-generated. Persisted with the terminal EvaluatorGenerationJob.

Properties

code

Stable searchable machine-readable warning code.

message

Human-readable message suitable for direct SDK/CLI/UI display. Must not include raw prompt, instruction, dataset, or trace text.

severity

Advisory severity. Initial values: warning.

source

Which source category the warning applies to. aggregate is used only for cross-source warnings.

source_index

Zero-based index into EvaluatorGenerationJob.inputs.sources when the warning applies to a specific source. Omitted for aggregate warnings and for warnings not tied to one source.

Property Details

code

Stable searchable machine-readable warning code.

code: RubricGenerationInputQualityWarningCode

Property Value

message

Human-readable message suitable for direct SDK/CLI/UI display. Must not include raw prompt, instruction, dataset, or trace text.

message: string

Property Value

string

severity

Advisory severity. Initial values: warning.

severity: "warning"

Property Value

"warning"

source

Which source category the warning applies to. aggregate is used only for cross-source warnings.

source: RubricGenerationInputQualityWarningSource

Property Value

source_index

Zero-based index into EvaluatorGenerationJob.inputs.sources when the warning applies to a specific source. Omitted for aggregate warnings and for warnings not tied to one source.

source_index?: number

Property Value

number