Language

RecommendVmSkuModel Class

Definition

Model inputs used for metadata resolution and memory sizing.

public class RecommendVmSkuModel : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuModel>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuModel>
type RecommendVmSkuModel = class
    interface IJsonModel<RecommendVmSkuModel>
    interface IPersistableModel<RecommendVmSkuModel>
Public Class RecommendVmSkuModel
Implements IJsonModel(Of RecommendVmSkuModel), IPersistableModel(Of RecommendVmSkuModel)
Inheritance
RecommendVmSkuModel
Implements

Constructors

Name Description
RecommendVmSkuModel()

Initializes a new instance of RecommendVmSkuModel.

Properties

Name Description
HeadDim

The attention head dimension, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count.

HuggingFaceModelId

The Hugging Face model identifier, for example meta-llama/Llama-3.1-70B-Instruct.

MaxContextLength

The maximum context length the model supports, in tokens. Used only as an upper bound for the sizing context length when Hugging Face metadata provides no usable maximum.

NumKeyValueHeads

The model key-value head count, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count.

NumLayers

The model layer count, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count.

ParameterCount

The logical total model parameter count, including all mixture-of-experts experts. May be supplied with or without a model identifier.

WeightPrecision

The precision the model weights are served at. Matched case-insensitively.

Methods

Name Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name Description
IJsonModel<RecommendVmSkuModel>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<RecommendVmSkuModel>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuModel>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuModel>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuModel>.Write(ModelReaderWriterOptions)

Applies to