ArmAIInfraOptimizationModelFactory.RecommendVmSkuPerformanceEstimate Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
An advisory deployment throughput and per-request latency estimate.
public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuPerformanceEstimate RecommendVmSkuPerformanceEstimate(double deploymentOutputTokensPerSecond = 0, double ttftMs = 0);
static member RecommendVmSkuPerformanceEstimate : double * double -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuPerformanceEstimate
Public Shared Function RecommendVmSkuPerformanceEstimate (Optional deploymentOutputTokensPerSecond As Double = 0, Optional ttftMs As Double = 0) As RecommendVmSkuPerformanceEstimate
Parameters
- deploymentOutputTokensPerSecond
- Double
The estimated number of output tokens generated per second across the whole deployment.
- ttftMs
- Double
The estimated time to first token for a single request, in milliseconds.
Returns
A new RecommendVmSkuPerformanceEstimate instance for mocking.