Language

RecommendVmSkuTokenBudget Class

Definition

The per-request token budget used to size the inference key-value cache.

public class RecommendVmSkuTokenBudget : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuTokenBudget>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.AIInfraOptimization.Models.RecommendVmSkuTokenBudget>
type RecommendVmSkuTokenBudget = class
    interface IJsonModel<RecommendVmSkuTokenBudget>
    interface IPersistableModel<RecommendVmSkuTokenBudget>
Public Class RecommendVmSkuTokenBudget
Implements IJsonModel(Of RecommendVmSkuTokenBudget), IPersistableModel(Of RecommendVmSkuTokenBudget)
Inheritance
RecommendVmSkuTokenBudget
Implements

Constructors

Name Description
RecommendVmSkuTokenBudget()

Initializes a new instance of RecommendVmSkuTokenBudget.

Properties

Name Description
MaxOutputTokens

The maximum number of generated output tokens per inference request. Must be supplied together with promptTokens, and the two must total from 1 through 131072.

PromptTokens

The number of prompt, or input, tokens per inference request. Must be supplied together with maxOutputTokens, and the two must total from 1 through 131072.

Methods

Name Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name Description
IJsonModel<RecommendVmSkuTokenBudget>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<RecommendVmSkuTokenBudget>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuTokenBudget>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuTokenBudget>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<RecommendVmSkuTokenBudget>.Write(ModelReaderWriterOptions)

Applies to