Language

ArmAIInfraOptimizationModelFactory.RecommendVmSkuBenchmark Method

Definition

The external benchmark evidence selected for one virtual machine size option.

public static Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark RecommendVmSkuBenchmark(Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmarkLevel level = default, string modelClass = default, string scenario = default, int submitterCount = 0, string submissionId = default, string benchmarkModel = default, string submitter = default, string system = default, double? throughput = default, string throughputUnit = default, string software = default, string operatingSystem = default, string weightDataTypes = default, double? p99TtftMs = default, double? p99TpotMs = default);
static member RecommendVmSkuBenchmark : Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmarkLevel * string * string * int * string * string * string * string * Nullable<double> * string * string * string * string * Nullable<double> * Nullable<double> -> Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark
Public Shared Function RecommendVmSkuBenchmark (Optional level As RecommendVmSkuBenchmarkLevel = Nothing, Optional modelClass As String = Nothing, Optional scenario As String = Nothing, Optional submitterCount As Integer = 0, Optional submissionId As String = Nothing, Optional benchmarkModel As String = Nothing, Optional submitter As String = Nothing, Optional system As String = Nothing, Optional throughput As Nullable(Of Double) = Nothing, Optional throughputUnit As String = Nothing, Optional software As String = Nothing, Optional operatingSystem As String = Nothing, Optional weightDataTypes As String = Nothing, Optional p99TtftMs As Nullable(Of Double) = Nothing, Optional p99TpotMs As Nullable(Of Double) = Nothing) As RecommendVmSkuBenchmark

Parameters

level
RecommendVmSkuBenchmarkLevel

How closely the benchmark evidence matches the recommended topology.

modelClass
String

The model size class the benchmark covers, for example 70b.

scenario
String

The benchmark scenario, for example Server or Offline.

submitterCount
Int32

The number of submitters that published results for this configuration.

submissionId
String

The identifier of the selected benchmark submission.

benchmarkModel
String

The model the benchmark was measured on.

submitter
String

The organization that published the benchmark submission.

system
String

The system the benchmark was measured on.

throughput
Nullable<Double>

The throughput observed in the benchmark submission.

throughputUnit
String

The unit the observed throughput is expressed in, for example Tokens/s.

software
String

The serving software the benchmark was measured with.

operatingSystem
String

The operating system the benchmark was measured on.

weightDataTypes
String

The weight data types used in the benchmark submission.

p99TtftMs
Nullable<Double>

The 99th-percentile time to first token observed in the benchmark, in milliseconds.

p99TpotMs
Nullable<Double>

The 99th-percentile time per output token observed in the benchmark, in milliseconds.

Returns

A new RecommendVmSkuBenchmark instance for mocking.

Applies to