ModelDeploymentStatus Class

Definition

Namespace:

Azure.ResourceManager.ContainerServiceAIManager.Models

Assembly:

Azure.ResourceManager.ContainerServiceAIManager.dll

Package:

Azure.ResourceManager.ContainerServiceAIManager v1.0.0-beta.1

Source:

ModelDeploymentStatus.cs

The runtime status of a model deployment. All fields are read-only and populated once reconciliation has started.

public class ModelDeploymentStatus : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.ContainerServiceAIManager.Models.ModelDeploymentStatus>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.ContainerServiceAIManager.Models.ModelDeploymentStatus>

type ModelDeploymentStatus = class
    interface IJsonModel<ModelDeploymentStatus>
    interface IPersistableModel<ModelDeploymentStatus>

Public Class ModelDeploymentStatus
Implements IJsonModel(Of ModelDeploymentStatus), IPersistableModel(Of ModelDeploymentStatus)

Inheritance

Object

ModelDeploymentStatus

Implements

IJsonModel<ModelDeploymentStatus> IPersistableModel<ModelDeploymentStatus> IPersistableModel<T>

Properties

Name	Description
CurrentReplicas	The current number of ready replicas serving traffic.
DesiredReplicas	The desired replica count reported by the controller. Equals properties.scale.manual.replicas when manual scaling is used; current target replica count derived from autoscaler otherwise.
Endpoint	The inference endpoint URL exposed by the deployment, once ready.
Engine	The inference engine used to serve the model, e.g. "vllm".
EngineVersion	The version of the inference engine, e.g. "0.17".
EstimatedProvisionTimeSeconds	Estimated total time, in seconds, for the deployment to become ready end-to-end (GPU vm provisioning, image/weight pull, engine warm-up).
MaxModelLen	The maximum model context length, in tokens, configured for this deployment.
PeakTokensPerMinute	The peak tokens per minute measured by live stress test.
Quantization	The quantization level applied to the model weights, e.g. "fp16", "awq-int4".

Methods

Name	Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name	Description
IJsonModel<ModelDeploymentStatus>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<ModelDeploymentStatus>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<ModelDeploymentStatus>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<ModelDeploymentStatus>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<ModelDeploymentStatus>.Write(ModelReaderWriterOptions)