Language

AIModelServingPerformanceEstimation.RelativeLatencyScore Property

Definition

Relative inference latency score in [0, 1]. Higher is better (1 matches the best-performing SKU's latency for this model). Note: this is a normalized score, not a raw latency ratio -- a larger value indicates lower latency.

public float RelativeLatencyScore { get; }
member this.RelativeLatencyScore : single
Public ReadOnly Property RelativeLatencyScore As Single

Property Value

Applies to