DeploymentSpeculativeDecoding Class

Definition

Namespace:

Azure.ResourceManager.CognitiveServices.Models

Assembly:

Azure.ResourceManager.CognitiveServices.dll

Package:

Azure.ResourceManager.CognitiveServices v1.6.0-beta.3

Source:

DeploymentSpeculativeDecoding.cs

Speculative decoding settings for a deployment.

public class DeploymentSpeculativeDecoding : System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.CognitiveServices.Models.DeploymentSpeculativeDecoding>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.CognitiveServices.Models.DeploymentSpeculativeDecoding>

type DeploymentSpeculativeDecoding = class
    interface IJsonModel<DeploymentSpeculativeDecoding>
    interface IPersistableModel<DeploymentSpeculativeDecoding>

Public Class DeploymentSpeculativeDecoding
Implements IJsonModel(Of DeploymentSpeculativeDecoding), IPersistableModel(Of DeploymentSpeculativeDecoding)

Inheritance

Object

DeploymentSpeculativeDecoding

Implements

IJsonModel<DeploymentSpeculativeDecoding> IPersistableModel<DeploymentSpeculativeDecoding> IPersistableModel<T>

Constructors

Name	Description
DeploymentSpeculativeDecoding(CognitiveServicesAccountDeploymentModel)	Initializes a new instance of DeploymentSpeculativeDecoding.

Properties

Name	Description
DraftModel	Draft model used to generate speculative decoding tokens.
DraftTokenCount	The number of draft tokens attempted per speculation step.

Methods

Name	Description
JsonModelCreateCore(Utf8JsonReader, ModelReaderWriterOptions)
JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)
PersistableModelCreateCore(BinaryData, ModelReaderWriterOptions)
PersistableModelWriteCore(ModelReaderWriterOptions)

Explicit Interface Implementations

Name	Description
IJsonModel<DeploymentSpeculativeDecoding>.Create(Utf8JsonReader, ModelReaderWriterOptions)
IJsonModel<DeploymentSpeculativeDecoding>.Write(Utf8JsonWriter, ModelReaderWriterOptions)
IPersistableModel<DeploymentSpeculativeDecoding>.Create(BinaryData, ModelReaderWriterOptions)
IPersistableModel<DeploymentSpeculativeDecoding>.GetFormatFromOptions(ModelReaderWriterOptions)
IPersistableModel<DeploymentSpeculativeDecoding>.Write(ModelReaderWriterOptions)