Поделиться через

MicrosoftTokenizerLanguage Перечисление

  • Ссылка

Список языков, поддерживаемых создателем маркеров языка Майкрософт.

Наследование
builtins.str
MicrosoftTokenizerLanguage
Enum
MicrosoftTokenizerLanguage

Конструктор

MicrosoftTokenizerLanguage(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Поля

BANGLA
BULGARIAN
CATALAN
CHINESE_SIMPLIFIED
CHINESE_TRADITIONAL
CROATIAN
CZECH
DANISH
DUTCH
ENGLISH
FRENCH
GERMAN
GREEK
GUJARATI
HINDI
ICELANDIC
INDONESIAN
ITALIAN
JAPANESE
KANNADA
KOREAN
MALAY
MALAYALAM
MARATHI
NORWEGIAN_BOKMAAL
POLISH
PORTUGUESE
PORTUGUESE_BRAZILIAN
PUNJABI
ROMANIAN
RUSSIAN
SERBIAN_CYRILLIC
SERBIAN_LATIN
SLOVENIAN
SPANISH
SWEDISH
TAMIL
TELUGU
THAI
UKRAINIAN
URDU
VIETNAMESE