AzureOpenAITokenizerParameters Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
The AzureOpenAITokenizerParameters.
public class AzureOpenAITokenizerParameterstype AzureOpenAITokenizerParameters = classPublic Class AzureOpenAITokenizerParameters- Inheritance
-
AzureOpenAITokenizerParameters
Constructors
| AzureOpenAITokenizerParameters() |
Initializes a new instance of AzureOpenAITokenizerParameters. |
Properties
| AllowedSpecialTokens |
(Optional) Only applies if the unit is set to azureOpenAITokens. This parameter defines a collection of special tokens that are permitted within the tokenization process. |
| EncoderModelName |
Only applies if the unit is set to azureOpenAITokens. Options include 'R50k_base', 'P50k_base', 'P50k_edit' and 'CL100k_base'. The default value is 'CL100k_base'. |
Applies to
Collabora con noi su GitHub
L'origine di questo contenuto è disponibile in GitHub, in cui è anche possibile creare ed esaminare i problemi e le richieste pull. Per ulteriori informazioni, vedere la guida per i collaboratori.
