LexicalTokenizerName Enum

Defines the names of all tokenizers supported by the search engine.

Inheritance
builtins.str
LexicalTokenizerName
LexicalTokenizerName

Constructor

LexicalTokenizerName(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Fields

CLASSIC
EDGE_N_GRAM
KEYWORD
LETTER
LOWERCASE
MICROSOFT_LANGUAGE_STEMMING_TOKENIZER
MICROSOFT_LANGUAGE_TOKENIZER
N_GRAM
PATH_HIERARCHY
PATTERN
STANDARD
UAX_URL_EMAIL
WHITESPACE