RecommendVmSkuSizingWorkload Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The resolved per-replica workload inputs used for memory sizing.
public class RecommendVmSkuSizingWorkload : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuSizingWorkload>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuSizingWorkload>
type RecommendVmSkuSizingWorkload = class
interface IJsonModel<RecommendVmSkuSizingWorkload>
interface IPersistableModel<RecommendVmSkuSizingWorkload>
Public Class RecommendVmSkuSizingWorkload
Implements IJsonModel(Of RecommendVmSkuSizingWorkload), IPersistableModel(Of RecommendVmSkuSizingWorkload)
- Inheritance
-
RecommendVmSkuSizingWorkload
- Implements
Properties
| Name | Description |
|---|---|
| ContextLength |
The context length, in tokens, used to size the key-value cache: the sum of |
| MaxConcurrentRequestsPerReplica |
The maximum number of simultaneous inference requests handled by each replica. |