ModelSamplingParams interface

Package:

@azure/ai-projects

Represents a set of parameters used to control the sampling behavior of a language model during text generation.

Properties

max_completion_tokens	The maximum number of tokens allowed in the completion.
seed	The random seed for reproducibility.
temperature	The temperature parameter for sampling.
top_p	The top-p parameter for nucleus sampling.

Property Details

max_completion_tokens

The maximum number of tokens allowed in the completion.

max_completion_tokens: number

Property Value

number

seed

The random seed for reproducibility.

seed: number

Property Value

number

temperature

The temperature parameter for sampling.

temperature: number

Property Value

number

top_p

The top-p parameter for nucleus sampling.

top_p: number

Property Value

number