TextChunker.TokenCounter Delegate
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Delegate for counting tokens in a string.
public delegate int TextChunker.TokenCounter(string input);type TextChunker.TokenCounter = delegate of string -> intPublic Delegate Function TextChunker.TokenCounter(input As String) As Integer Parameters
- input
- String
The input string to count tokens in.
Return Value
The number of tokens in the input string.