PatternTokenizer Class

Definition

Namespace:

Azure.Search.Documents.Indexes.Models

Assembly:

Azure.Search.Documents.dll

Package:

Azure.Search.Documents v11.5.1

Source:

PatternTokenizer.cs

Tokenizer that uses regex pattern matching to construct distinct tokens. This tokenizer is implemented using Apache Lucene.

public class PatternTokenizer : Azure.Search.Documents.Indexes.Models.LexicalTokenizer

type PatternTokenizer = class
    inherit LexicalTokenizer

Public Class PatternTokenizer
Inherits LexicalTokenizer

Inheritance

Object

LexicalTokenizer

PatternTokenizer

Constructors

PatternTokenizer(String)

Initializes a new instance of PatternTokenizer.

Properties

Flags	Regular expression flags for Pattern.
Group	The zero-based ordinal of the matching group in the regular expression pattern to extract into tokens. Use -1 if you want to use the entire pattern to split the input into tokens, irrespective of matching groups. Default is -1.
Name	The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters. (Inherited from LexicalTokenizer)
Pattern	A regular expression pattern to match token separators. Default is an expression that matches one or more non-word characters.