DeploymentSpeculativeDecoding(CognitiveServicesAccountDeploymentModel) Constructor
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Initializes a new instance of DeploymentSpeculativeDecoding.
public DeploymentSpeculativeDecoding(Azure.ResourceManager.CognitiveServices.Models.CognitiveServicesAccountDeploymentModel draftModel);
new Azure.ResourceManager.CognitiveServices.Models.DeploymentSpeculativeDecoding : Azure.ResourceManager.CognitiveServices.Models.CognitiveServicesAccountDeploymentModel -> Azure.ResourceManager.CognitiveServices.Models.DeploymentSpeculativeDecoding
Public Sub New (draftModel As CognitiveServicesAccountDeploymentModel)
Parameters
- draftModel
- CognitiveServicesAccountDeploymentModel
Draft model used to generate speculative decoding tokens.
Exceptions
draftModel is null.