RubricBasedEvaluatorDefinition Class

Definition

Rubric-based evaluator definition — stores dimensions produced by the generate API. Used for both quality and safety evaluators.

public class RubricBasedEvaluatorDefinition : Azure.AI.Projects.Evaluation.EvaluatorDefinition, System.ClientModel.Primitives.IJsonModel<Azure.AI.Projects.RubricBasedEvaluatorDefinition>, System.ClientModel.Primitives.IPersistableModel<Azure.AI.Projects.RubricBasedEvaluatorDefinition>
type RubricBasedEvaluatorDefinition = class
    inherit EvaluatorDefinition
    interface IJsonModel<RubricBasedEvaluatorDefinition>
    interface IPersistableModel<RubricBasedEvaluatorDefinition>
Public Class RubricBasedEvaluatorDefinition
Inherits EvaluatorDefinition
Implements IJsonModel(Of RubricBasedEvaluatorDefinition), IPersistableModel(Of RubricBasedEvaluatorDefinition)
Inheritance
RubricBasedEvaluatorDefinition
Implements

Constructors

Name Description
RubricBasedEvaluatorDefinition(IEnumerable<EvaluationsDimension>)

Initializes a new instance of RubricBasedEvaluatorDefinition.

Properties

Name Description
DataSchema (Inherited from EvaluatorDefinition)
Dimensions

The set of dimensions — the scoring blueprint used by the LLM judge. Quality evaluators include a non-editable residual dimension with id 'general_quality' (always_applicable: true); safety evaluators include 'general_policy_compliance'. Both use the same Dimension structure.

InitParameters (Inherited from EvaluatorDefinition)
Metrics

List of output metrics produced by this evaluator.

(Inherited from EvaluatorDefinition)
PassThreshold

Pass/fail threshold for the aggregate rubric score, on the same normalized 0.0-1.0 scale as the emitted score. When the runtime weighted average meets or exceeds this value, the result is pass. Defaults to 0.5 (equivalent to a raw 1-5 weighted average of 3.0). The 'any dimension scored 1 → fail' rule still applies regardless of this threshold.

Methods

Name Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name Description
IJsonModel<EvaluatorDefinition>.Create(Utf8JsonReader, ModelReaderWriterOptions) (Inherited from EvaluatorDefinition)
IJsonModel<EvaluatorDefinition>.Write(Utf8JsonWriter, ModelReaderWriterOptions) (Inherited from EvaluatorDefinition)
IJsonModel<RubricBasedEvaluatorDefinition>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<RubricBasedEvaluatorDefinition>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<EvaluatorDefinition>.Create(BinaryData, ModelReaderWriterOptions) (Inherited from EvaluatorDefinition)
IPersistableModel<EvaluatorDefinition>.GetFormatFromOptions(ModelReaderWriterOptions) (Inherited from EvaluatorDefinition)
IPersistableModel<EvaluatorDefinition>.Write(ModelReaderWriterOptions) (Inherited from EvaluatorDefinition)
IPersistableModel<RubricBasedEvaluatorDefinition>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<RubricBasedEvaluatorDefinition>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<RubricBasedEvaluatorDefinition>.Write(ModelReaderWriterOptions)

Applies to