Language

ArmAIInfraOptimizationModelFactory.RecommendVmSkuMemory Method

Definition

The memory calculation shared by every returned option.

public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory RecommendVmSkuMemory(double modelWeightsGiB = 0, double kvCacheGiBPerRequest = 0, double kvCacheGiBTotal = 0, double modelAndKvCacheGiB = 0);
static member RecommendVmSkuMemory : double * double * double * double -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuMemory
Public Shared Function RecommendVmSkuMemory (Optional modelWeightsGiB As Double = 0, Optional kvCacheGiBPerRequest As Double = 0, Optional kvCacheGiBTotal As Double = 0, Optional modelAndKvCacheGiB As Double = 0) As RecommendVmSkuMemory

Parameters

modelWeightsGiB
Double

The memory required for the model weights, in gibibytes.

kvCacheGiBPerRequest
Double

The key-value cache memory required for a single concurrent request, in gibibytes.

kvCacheGiBTotal
Double

The key-value cache memory required for all concurrent requests on a replica, in gibibytes.

modelAndKvCacheGiB
Double

The combined model-weight and key-value cache memory required per replica, in gibibytes.

Returns

A new RecommendVmSkuMemory instance for mocking.

Applies to