RubricGenerationInputQualityWarning Class

A non-fatal advisory produced during rubric evaluator generation when resolved inputs are technically valid but likely too weak to produce a high-quality rubric. Read-only; service-generated. Persisted with the terminal EvaluatorGenerationJob.

Constructor

RubricGenerationInputQualityWarning(*args: Any, **kwargs: Any)

Variables

Name	Description
code	str or RubricGenerationInputQualityWarningCode Stable searchable machine-readable warning code. Required. Known values are: "empty_prompt", "short_prompt", "empty_agent_instructions", "short_agent_instructions", "empty_dataset_content", "short_dataset_content", "low_trace_count", and "insufficient_total_input".
severity	str or RubricGenerationInputQualityWarningSeverity Advisory severity. Initial values: warning. Required. "warning"
message	str Human-readable message suitable for direct SDK/CLI/UI display. Must not include raw prompt, instruction, dataset, or trace text. Required.
source	str or RubricGenerationInputQualityWarningSource Which source category the warning applies to. aggregate is used only for cross-source warnings. Required. Known values are: "prompt", "agent", "dataset", and "aggregate".
source_index	int Zero-based index into EvaluatorGenerationJob.inputs.sources when the warning applies to a specific source. Omitted for aggregate warnings and for warnings not tied to one source.

Methods

as_dict	Return a dict that can be turned into json using json.dump.
clear	Remove all items from D.
copy
get	Get the value for key if key is in the dictionary, else default. :param str key: The key to look up. :param any default: The value to return if key is not in the dictionary. Defaults to None :returns: D[k] if k in D, else d. :rtype: any
items
keys
pop	Removes specified key and return the corresponding value. :param str key: The key to pop. :param any default: The value to return if key is not in the dictionary :returns: The value corresponding to the key. :rtype: any :raises KeyError: If key is not found and default is not given.
popitem	Removes and returns some (key, value) pair :returns: The (key, value) pair. :rtype: tuple :raises KeyError: if D is empty.
setdefault	Same as calling D.get(k, d), and setting D[k]=d if k not found :param str key: The key to look up. :param any default: The value to set if key is not in the dictionary :returns: D[k] if k in D, else d. :rtype: any
update	Updates D from mapping/iterable E and F. :param any args: Either a mapping object or an iterable of key-value pairs.
values

as_dict

Return a dict that can be turned into json using json.dump.

as_dict(*, exclude_readonly: bool = False) -> dict[str, Any]

Keyword-Only Parameters

Name	Description
exclude_readonly	bool Whether to remove the readonly properties. Default value: False

Returns

Type	Description
dict	A dict JSON compatible object

clear

Remove all items from D.

clear() -> None

copy

copy() -> Model

get

Get the value for key if key is in the dictionary, else default. :param str key: The key to look up. :param any default: The value to return if key is not in the dictionary. Defaults to None :returns: D[k] if k in D, else d. :rtype: any

get(key: str, default: Any = None) -> Any

Parameters

Name	Description
key Required
default	Default value: None

items

items() -> ItemsView[str, Any]

Returns

Type	Description
ItemsView	set-like object providing a view on D's items

keys

keys() -> KeysView[str]

Returns

Type	Description
KeysView	a set-like object providing a view on D's keys

pop

Removes specified key and return the corresponding value. :param str key: The key to pop. :param any default: The value to return if key is not in the dictionary :returns: The value corresponding to the key. :rtype: any :raises KeyError: If key is not found and default is not given.

pop(key: str, default: ~typing.Any = <object object>) -> Any

Parameters

Name	Description
key Required
default

popitem

Removes and returns some (key, value) pair :returns: The (key, value) pair. :rtype: tuple :raises KeyError: if D is empty.

popitem() -> tuple[str, Any]

setdefault

Same as calling D.get(k, d), and setting D[k]=d if k not found :param str key: The key to look up. :param any default: The value to set if key is not in the dictionary :returns: D[k] if k in D, else d. :rtype: any

setdefault(key: str, default: ~typing.Any = <object object>) -> Any

Parameters

Name	Description
key Required
default

update

Updates D from mapping/iterable E and F. :param any args: Either a mapping object or an iterable of key-value pairs.

update(*args: Any, **kwargs: Any) -> None

values

values() -> ValuesView[Any]

Returns

Type	Description
ValuesView	an object providing a view on D's values

Attributes

code

"empty_prompt", "short_prompt", "empty_agent_instructions", "short_agent_instructions", "empty_dataset_content", "short_dataset_content", "low_trace_count", and "insufficient_total_input".

code: str | _models.RubricGenerationInputQualityWarningCode

message

Human-readable message suitable for direct SDK/CLI/UI display. Must not include raw prompt, instruction, dataset, or trace text. Required.

message: str

severity

warning. Required. "warning"

severity: str | _models.RubricGenerationInputQualityWarningSeverity

source

Which source category the warning applies to. aggregate is used only for cross-source warnings. Required. Known values are: "prompt", "agent", "dataset", and "aggregate".

source: str | _models.RubricGenerationInputQualityWarningSource

source_index

Zero-based index into EvaluatorGenerationJob.inputs.sources when the warning applies to a specific source. Omitted for aggregate warnings and for warnings not tied to one source.

source_index: int | None