Language

ArmAIInfraOptimizationModelFactory.RecommendVmSkuWorkload Method

Definition

Inference workload assumptions that affect memory sizing.

public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuWorkload RecommendVmSkuWorkload(int? maxConcurrentRequestsPerReplica = default, Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuTokenBudget tokenBudget = default);
static member RecommendVmSkuWorkload : Nullable<int> * Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuTokenBudget -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuWorkload
Public Shared Function RecommendVmSkuWorkload (Optional maxConcurrentRequestsPerReplica As Nullable(Of Integer) = Nothing, Optional tokenBudget As RecommendVmSkuTokenBudget = Nothing) As RecommendVmSkuWorkload

Parameters

maxConcurrentRequestsPerReplica
Nullable<Int32>

The maximum number of simultaneous inference requests handled by each deployment replica.

tokenBudget
RecommendVmSkuTokenBudget

The prompt and output token budget used for key-value cache sizing.

Returns

A new RecommendVmSkuWorkload instance for mocking.

Applies to