Language

ArmAIInfraOptimizationModelFactory.RecommendVmSkuPerformanceEstimate Method

Definition

An advisory deployment throughput and per-request latency estimate.

public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuPerformanceEstimate RecommendVmSkuPerformanceEstimate(double deploymentOutputTokensPerSecond = 0, double ttftMs = 0);
static member RecommendVmSkuPerformanceEstimate : double * double -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuPerformanceEstimate
Public Shared Function RecommendVmSkuPerformanceEstimate (Optional deploymentOutputTokensPerSecond As Double = 0, Optional ttftMs As Double = 0) As RecommendVmSkuPerformanceEstimate

Parameters

deploymentOutputTokensPerSecond
Double

The estimated number of output tokens generated per second across the whole deployment.

ttftMs
Double

The estimated time to first token for a single request, in milliseconds.

Returns

A new RecommendVmSkuPerformanceEstimate instance for mocking.

Applies to