Language

RecommendVmSkuBenchmark Class

Definition

The external benchmark evidence selected for one virtual machine size option.

public class RecommendVmSkuBenchmark : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuBenchmark>
type RecommendVmSkuBenchmark = class
    interface IJsonModel<RecommendVmSkuBenchmark>
    interface IPersistableModel<RecommendVmSkuBenchmark>
Public Class RecommendVmSkuBenchmark
Implements IJsonModel(Of RecommendVmSkuBenchmark), IPersistableModel(Of RecommendVmSkuBenchmark)
Inheritance
RecommendVmSkuBenchmark
Implements

Properties

Name Description
BenchmarkModel

The model the benchmark was measured on.

Level

How closely the benchmark evidence matches the recommended topology.

ModelClass

The model size class the benchmark covers, for example 70b.

OperatingSystem

The operating system the benchmark was measured on.

P99TpotMs

The 99th-percentile time per output token observed in the benchmark, in milliseconds.

P99TtftMs

The 99th-percentile time to first token observed in the benchmark, in milliseconds.

Scenario

The benchmark scenario, for example Server or Offline.

Software

The serving software the benchmark was measured with.

SubmissionId

The identifier of the selected benchmark submission.

Submitter

The organization that published the benchmark submission.

SubmitterCount

The number of submitters that published results for this configuration.

System

The system the benchmark was measured on.

Throughput

The throughput observed in the benchmark submission.

ThroughputUnit

The unit the observed throughput is expressed in, for example Tokens/s.

WeightDataTypes

The weight data types used in the benchmark submission.

Methods

Name Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name Description
IJsonModel<RecommendVmSkuBenchmark>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<RecommendVmSkuBenchmark>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuBenchmark>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuBenchmark>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuBenchmark>.Write(ModelReaderWriterOptions)

Applies to