Azure.ResourceManager.AIInfraOptimization.Models Namespace

Classes

Name Description
AIInfraOptimizationRecommendVmSkuOptionConfig

One ranked virtual machine size recommendation.

ArmAIInfraOptimizationModelFactory

A factory class for creating instances of the models for mocking.

RecommendVmSkuAccelerator

The accelerator hardware available in each virtual machine.

RecommendVmSkuBenchmark

The external benchmark evidence selected for one virtual machine size option.

RecommendVmSkuContent

The parameters used to request an Azure virtual machine size recommendation for an AI workload.

RecommendVmSkuCost

The deployment cost for one virtual machine size option.

RecommendVmSkuDeployment

Deployment scale and procurement inputs.

RecommendVmSkuHourlyCost

A currency-qualified deployment-wide hourly cost.

RecommendVmSkuMemory

The memory calculation shared by every returned option.

RecommendVmSkuModel

Model inputs used for metadata resolution and memory sizing.

RecommendVmSkuOptimization

Ranking preference and optional deployment-wide hourly cost limit.

RecommendVmSkuPerformanceEstimate

An advisory deployment throughput and per-request latency estimate.

RecommendVmSkuPlacement

The capacity placement evidence for one virtual machine size option.

RecommendVmSkuQuota

The subscription quota evidence for one virtual machine size option.

RecommendVmSkuQuotaIncrease

The quota limits to raise before retrying a deployment.

RecommendVmSkuQuotaLimit

One quota limit that blocks the requested deployment.

RecommendVmSkuReadiness

How ready a recommended option is to deploy.

RecommendVmSkuResult

The recommended Azure virtual machine sizes for the workload, with the sizing calculation they were derived from.

RecommendVmSkuSizing

The resolved workload sizing shared by every recommended option.

RecommendVmSkuSizingBasis

The sources used for the sizing calculation.

RecommendVmSkuSizingModel

The resolved model identity and weight precision.

RecommendVmSkuSizingWorkload

The resolved per-replica workload inputs used for memory sizing.

RecommendVmSkuStageError

An error from an optional subscription-scoped recommendation stage.

RecommendVmSkuSubscriptionConfig

The subscription-scoped lookups to include in the recommendation.

RecommendVmSkuTokenBudget

The per-request token budget used to size the inference key-value cache.

RecommendVmSkuTopology

The deployment topology for one virtual machine size option.

RecommendVmSkuWorkload

Inference workload assumptions that affect memory sizing.

Structs

Name Description
ContextLengthSource

Where a context length was resolved from.

ModelWeightsCalculation

How model weight memory was calculated.

ParameterCountSource

Where a model parameter count was resolved from.

RecommendVmSkuBenchmarkLevel

How closely benchmark evidence matches a recommended topology.

RecommendVmSkuCostSource

The source a price was resolved from.

RecommendVmSkuPlacementStatus

The outcome of a capacity placement query.

RecommendVmSkuProcurementOption

The Azure virtual machine procurement option.

RecommendVmSkuQuotaStatus

Whether subscription quota is sufficient for a requested deployment.

RecommendVmSkuRankingPreference

The preference used to rank the recommended options.

RecommendVmSkuReadinessStatus

The current actionability of a recommended option.

RecommendVmSkuStageErrorCode

The reason an optional subscription-scoped stage did not complete.

WeightPrecision

The precision a model's weights are served at.