AIModelServingPerformanceEstimation Class

Definition

Namespace:

Azure.ResourceManager.ContainerServiceAIManager.Models

Assembly:

Azure.ResourceManager.ContainerServiceAIManager.dll

Package:

Azure.ResourceManager.ContainerServiceAIManager v1.0.0-beta.1

Source:

AIModelServingPerformanceEstimation.cs

Estimated relative inference performance of a single model replica on a given GPU SKU. Each metric is a scaling coefficient in the range [0, 1] relative to the best-performing SKU for this model, which scores 1.

public class AIModelServingPerformanceEstimation : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.ContainerServiceAIManager.Models.AIModelServingPerformanceEstimation>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.ContainerServiceAIManager.Models.AIModelServingPerformanceEstimation>

type AIModelServingPerformanceEstimation = class
    interface IJsonModel<AIModelServingPerformanceEstimation>
    interface IPersistableModel<AIModelServingPerformanceEstimation>

Public Class AIModelServingPerformanceEstimation
Implements IJsonModel(Of AIModelServingPerformanceEstimation), IPersistableModel(Of AIModelServingPerformanceEstimation)

Inheritance

Object

AIModelServingPerformanceEstimation

Implements

IJsonModel<AIModelServingPerformanceEstimation> IPersistableModel<AIModelServingPerformanceEstimation> IPersistableModel<T>

Properties

Name	Description
RelativeLatencyScore	Relative inference latency score in [0, 1]. Higher is better (1 matches the best-performing SKU's latency for this model). Note: this is a normalized score, not a raw latency ratio -- a larger value indicates lower latency.
RelativeThroughputScore	Relative inference throughput score in [0, 1]. Higher is better (1 matches the best-performing SKU's throughput for this model).

Methods

Name	Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name	Description
IJsonModel<AIModelServingPerformanceEstimation>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<AIModelServingPerformanceEstimation>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<AIModelServingPerformanceEstimation>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<AIModelServingPerformanceEstimation>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<AIModelServingPerformanceEstimation>.Write(ModelReaderWriterOptions)