AIModelServingPerformanceEstimation.RelativeLatencyScore Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Relative inference latency score in [0, 1]. Higher is better (1 matches the best-performing SKU's latency for this model). Note: this is a normalized score, not a raw latency ratio -- a larger value indicates lower latency.
public float RelativeLatencyScore { get; }
member this.RelativeLatencyScore : single
Public ReadOnly Property RelativeLatencyScore As Single