Azure.ResourceManager.AIInfraOptimization.Models Namespace
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Classes
| Name | Description |
|---|---|
| AIInfraOptimizationRecommendVmSkuOptionConfig |
One ranked virtual machine size recommendation. |
| ArmAIInfraOptimizationModelFactory |
A factory class for creating instances of the models for mocking. |
| RecommendVmSkuAccelerator |
The accelerator hardware available in each virtual machine. |
| RecommendVmSkuBenchmark |
The external benchmark evidence selected for one virtual machine size option. |
| RecommendVmSkuContent |
The parameters used to request an Azure virtual machine size recommendation for an AI workload. |
| RecommendVmSkuCost |
The deployment cost for one virtual machine size option. |
| RecommendVmSkuDeployment |
Deployment scale and procurement inputs. |
| RecommendVmSkuHourlyCost |
A currency-qualified deployment-wide hourly cost. |
| RecommendVmSkuMemory |
The memory calculation shared by every returned option. |
| RecommendVmSkuModel |
Model inputs used for metadata resolution and memory sizing. |
| RecommendVmSkuOptimization |
Ranking preference and optional deployment-wide hourly cost limit. |
| RecommendVmSkuPerformanceEstimate |
An advisory deployment throughput and per-request latency estimate. |
| RecommendVmSkuPlacement |
The capacity placement evidence for one virtual machine size option. |
| RecommendVmSkuQuota |
The subscription quota evidence for one virtual machine size option. |
| RecommendVmSkuQuotaIncrease |
The quota limits to raise before retrying a deployment. |
| RecommendVmSkuQuotaLimit |
One quota limit that blocks the requested deployment. |
| RecommendVmSkuReadiness |
How ready a recommended option is to deploy. |
| RecommendVmSkuResult |
The recommended Azure virtual machine sizes for the workload, with the sizing calculation they were derived from. |
| RecommendVmSkuSizing |
The resolved workload sizing shared by every recommended option. |
| RecommendVmSkuSizingBasis |
The sources used for the sizing calculation. |
| RecommendVmSkuSizingModel |
The resolved model identity and weight precision. |
| RecommendVmSkuSizingWorkload |
The resolved per-replica workload inputs used for memory sizing. |
| RecommendVmSkuStageError |
An error from an optional subscription-scoped recommendation stage. |
| RecommendVmSkuSubscriptionConfig |
The subscription-scoped lookups to include in the recommendation. |
| RecommendVmSkuTokenBudget |
The per-request token budget used to size the inference key-value cache. |
| RecommendVmSkuTopology |
The deployment topology for one virtual machine size option. |
| RecommendVmSkuWorkload |
Inference workload assumptions that affect memory sizing. |
Structs
| Name | Description |
|---|---|
| ContextLengthSource |
Where a context length was resolved from. |
| ModelWeightsCalculation |
How model weight memory was calculated. |
| ParameterCountSource |
Where a model parameter count was resolved from. |
| RecommendVmSkuBenchmarkLevel |
How closely benchmark evidence matches a recommended topology. |
| RecommendVmSkuCostSource |
The source a price was resolved from. |
| RecommendVmSkuPlacementStatus |
The outcome of a capacity placement query. |
| RecommendVmSkuProcurementOption |
The Azure virtual machine procurement option. |
| RecommendVmSkuQuotaStatus |
Whether subscription quota is sufficient for a requested deployment. |
| RecommendVmSkuRankingPreference |
The preference used to rank the recommended options. |
| RecommendVmSkuReadinessStatus |
The current actionability of a recommended option. |
| RecommendVmSkuStageErrorCode |
The reason an optional subscription-scoped stage did not complete. |
| WeightPrecision |
The precision a model's weights are served at. |