RecommendVmSkuModel Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Model inputs used for metadata resolution and memory sizing.
public class RecommendVmSkuModel : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuModel>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuModel>
type RecommendVmSkuModel = class
interface IJsonModel<RecommendVmSkuModel>
interface IPersistableModel<RecommendVmSkuModel>
Public Class RecommendVmSkuModel
Implements IJsonModel(Of RecommendVmSkuModel), IPersistableModel(Of RecommendVmSkuModel)
- Inheritance
-
RecommendVmSkuModel
- Implements
Constructors
| Name | Description |
|---|---|
| RecommendVmSkuModel() |
Initializes a new instance of RecommendVmSkuModel. |
Properties
| Name | Description |
|---|---|
| HeadDim |
The attention head dimension, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count. |
| HuggingFaceModelId |
The Hugging Face model identifier, for example |
| MaxContextLength |
The maximum context length the model supports, in tokens. Used only as an upper bound for the sizing context length when Hugging Face metadata provides no usable maximum. |
| NumKeyValueHeads |
The model key-value head count, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count. |
| NumLayers |
The model layer count, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count. |
| ParameterCount |
The logical total model parameter count, including all mixture-of-experts experts. May be supplied with or without a model identifier. |
| WeightPrecision |
The precision the model weights are served at. Matched case-insensitively. |