Token interface

Package:

botbuilder-dialogs

Individual token returned by a TokenizerFunction.

Properties

end	End character position of the token within the outer string.
normalized	Normalized form of the token. This can include things like lower casing or stemming.
start	Start character position of the token within the outer string.
text	Original text of the token.

Property Details

end

End character position of the token within the outer string.

end: number

Property Value

number

normalized

Normalized form of the token. This can include things like lower casing or stemming.

normalized: string

Property Value

string

start

Start character position of the token within the outer string.

start: number

Property Value

number

text

Original text of the token.

text: string

Property Value

string