RecommendVmSkuMemory Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The memory calculation shared by every returned option.
public class RecommendVmSkuMemory : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory>
type RecommendVmSkuMemory = class
interface IJsonModel<RecommendVmSkuMemory>
interface IPersistableModel<RecommendVmSkuMemory>
Public Class RecommendVmSkuMemory
Implements IJsonModel(Of RecommendVmSkuMemory), IPersistableModel(Of RecommendVmSkuMemory)
- Inheritance
-
RecommendVmSkuMemory
- Implements
Properties
| Name | Description |
|---|---|
| KvCacheGiBPerRequest |
The key-value cache memory required for a single concurrent request, in gibibytes. |
| KvCacheGiBTotal |
The key-value cache memory required for all concurrent requests on a replica, in gibibytes. |
| ModelAndKvCacheGiB |
The combined model-weight and key-value cache memory required per replica, in gibibytes. |
| ModelWeightsGiB |
The memory required for the model weights, in gibibytes. |