ArmAIInfraOptimizationModelFactory.RecommendVmSkuBenchmark Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The external benchmark evidence selected for one virtual machine size option.
public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark RecommendVmSkuBenchmark(Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmarkLevel level = default, string modelClass = default, string scenario = default, int submitterCount = 0, string submissionId = default, string benchmarkModel = default, string submitter = default, string system = default, double? throughput = default, string throughputUnit = default, string software = default, string operatingSystem = default, string weightDataTypes = default, double? p99TtftMs = default, double? p99TpotMs = default);
static member RecommendVmSkuBenchmark : Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmarkLevel * string * string * int * string * string * string * string * Nullable<double> * string * string * string * string * Nullable<double> * Nullable<double> -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark
Public Shared Function RecommendVmSkuBenchmark (Optional level As RecommendVmSkuBenchmarkLevel = Nothing, Optional modelClass As String = Nothing, Optional scenario As String = Nothing, Optional submitterCount As Integer = 0, Optional submissionId As String = Nothing, Optional benchmarkModel As String = Nothing, Optional submitter As String = Nothing, Optional system As String = Nothing, Optional throughput As Nullable(Of Double) = Nothing, Optional throughputUnit As String = Nothing, Optional software As String = Nothing, Optional operatingSystem As String = Nothing, Optional weightDataTypes As String = Nothing, Optional p99TtftMs As Nullable(Of Double) = Nothing, Optional p99TpotMs As Nullable(Of Double) = Nothing) As RecommendVmSkuBenchmark
Parameters
How closely the benchmark evidence matches the recommended topology.
- modelClass
- String
The model size class the benchmark covers, for example 70b.
- scenario
- String
The benchmark scenario, for example Server or Offline.
- submitterCount
- Int32
The number of submitters that published results for this configuration.
- submissionId
- String
The identifier of the selected benchmark submission.
- benchmarkModel
- String
The model the benchmark was measured on.
- submitter
- String
The organization that published the benchmark submission.
- system
- String
The system the benchmark was measured on.
- throughputUnit
- String
The unit the observed throughput is expressed in, for example Tokens/s.
- software
- String
The serving software the benchmark was measured with.
- operatingSystem
- String
The operating system the benchmark was measured on.
- weightDataTypes
- String
The weight data types used in the benchmark submission.
The 99th-percentile time to first token observed in the benchmark, in milliseconds.
The 99th-percentile time per output token observed in the benchmark, in milliseconds.
Returns
A new RecommendVmSkuBenchmark instance for mocking.