DeploymentSpeculativeDecoding.DraftTokenCount Property

Definition

Namespace:: Azure.ResourceManager.CognitiveServices.Models

Assembly:: Azure.ResourceManager.CognitiveServices.dll

Package:: Azure.ResourceManager.CognitiveServices v1.6.0-beta.3

Source:: DeploymentSpeculativeDecoding.cs

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

The number of draft tokens attempted per speculation step.

public int? DraftTokenCount { get; set; }

member this.DraftTokenCount : Nullable<int> with get, set

Public Property DraftTokenCount As Nullable(Of Integer)

Property Value

Nullable<Int32>

Applies to

Feedback

Was this page helpful?