ArmAIInfraOptimizationModelFactory.RecommendVmSkuMemory Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The memory calculation shared by every returned option.
public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory RecommendVmSkuMemory(double modelWeightsGiB = 0, double kvCacheGiBPerRequest = 0, double kvCacheGiBTotal = 0, double modelAndKvCacheGiB = 0);
static member RecommendVmSkuMemory : double * double * double * double -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory
Public Shared Function RecommendVmSkuMemory (Optional modelWeightsGiB As Double = 0, Optional kvCacheGiBPerRequest As Double = 0, Optional kvCacheGiBTotal As Double = 0, Optional modelAndKvCacheGiB As Double = 0) As RecommendVmSkuMemory
Parameters
- modelWeightsGiB
- Double
The memory required for the model weights, in gibibytes.
- kvCacheGiBPerRequest
- Double
The key-value cache memory required for a single concurrent request, in gibibytes.
- kvCacheGiBTotal
- Double
The key-value cache memory required for all concurrent requests on a replica, in gibibytes.
- modelAndKvCacheGiB
- Double
The combined model-weight and key-value cache memory required per replica, in gibibytes.
Returns
A new RecommendVmSkuMemory instance for mocking.