RecommendVmSkuPerformanceEstimate interface
An advisory deployment throughput and per-request latency estimate.
Properties
| deployment |
The estimated number of output tokens generated per second across the whole deployment. |
| ttft |
The estimated time to first token for a single request, in milliseconds. |
Property Details
deploymentOutputTokensPerSecond
The estimated number of output tokens generated per second across the whole deployment.
deploymentOutputTokensPerSecond: numberProperty Value
number
ttftMs
The estimated time to first token for a single request, in milliseconds.
ttftMs: numberProperty Value
number
