AzureAIProjectsModelFactory.RubricBasedEvaluatorDefinition Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Rubric-based evaluator definition — stores dimensions produced by the generate API. Used for both quality and safety evaluators.
public static Azure.AI.Projects.RubricBasedEvaluatorDefinition RubricBasedEvaluatorDefinition(BinaryData initParameters = default, BinaryData dataSchema = default, System.Collections.Generic.IDictionary<string,Azure.AI.Projects.Evaluation.EvaluatorMetric> metrics = default, System.Collections.Generic.IEnumerable<Azure.AI.Projects.Evaluation.EvaluationsDimension> dimensions = default, float? passThreshold = default);static member RubricBasedEvaluatorDefinition : BinaryData * BinaryData * System.Collections.Generic.IDictionary<string, Azure.AI.Projects.Evaluation.EvaluatorMetric> * seq<Azure.AI.Projects.Evaluation.EvaluationsDimension> * Nullable<single> -> Azure.AI.Projects.RubricBasedEvaluatorDefinitionPublic Shared Function RubricBasedEvaluatorDefinition (Optional initParameters As BinaryData = Nothing, Optional dataSchema As BinaryData = Nothing, Optional metrics As IDictionary(Of String, EvaluatorMetric) = Nothing, Optional dimensions As IEnumerable(Of EvaluationsDimension) = Nothing, Optional passThreshold As Nullable(Of Single) = Nothing) As RubricBasedEvaluatorDefinitionParameters
- initParameters
- BinaryData
The JSON schema (Draft 2020-12) for the evaluator's input parameters. This includes parameters like type, properties, required.
- dataSchema
- BinaryData
The JSON schema (Draft 2020-12) for the evaluator's input data. This includes parameters like type, properties, required.
- metrics
- IDictionary<String,EvaluatorMetric>
List of output metrics produced by this evaluator.
- dimensions
- IEnumerable<EvaluationsDimension>
The set of dimensions — the scoring blueprint used by the LLM judge. Quality evaluators include a non-editable residual dimension with id 'general_quality' (always_applicable: true); safety evaluators include 'general_policy_compliance'. Both use the same Dimension structure.
Pass/fail threshold for the aggregate rubric score, on the same normalized 0.0-1.0 scale as the emitted score. When the runtime weighted average meets or exceeds this value, the result is pass. Defaults to 0.5 (equivalent to a raw 1-5 weighted average of 3.0). The 'any dimension scored 1 → fail' rule still applies regardless of this threshold.
Returns
A new RubricBasedEvaluatorDefinition instance for mocking.
