WordDelimiterTokenFilter Class

Definition

Splits words into subwords and performs optional transformations on subword groups. This token filter is implemented using Apache Lucene.

public class WordDelimiterTokenFilter : Azure.Search.Documents.Indexes.Models.TokenFilter
type WordDelimiterTokenFilter = class
    inherit TokenFilter
Public Class WordDelimiterTokenFilter
Inherits TokenFilter
Inheritance
WordDelimiterTokenFilter

Constructors

WordDelimiterTokenFilter(String)

Initializes a new instance of WordDelimiterTokenFilter.

Properties

CatenateAll

A value indicating whether all subword parts will be catenated. For example, if this is set to true, "Azure-Search-1" becomes "AzureSearch1". Default is false.

CatenateNumbers

A value indicating whether maximum runs of number parts will be catenated. For example, if this is set to true, "1-2" becomes "12". Default is false.

CatenateWords

A value indicating whether maximum runs of word parts will be catenated. For example, if this is set to true, "Azure-Search" becomes "AzureSearch". Default is false.

GenerateNumberParts

A value indicating whether to generate number subwords. Default is true.

GenerateWordParts

A value indicating whether to generate part words. If set, causes parts of words to be generated; for example "AzureSearch" becomes "Azure" "Search". Default is true.

Name

The name of the token filter. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters.

(Inherited from TokenFilter)
PreserveOriginal

A value indicating whether original words will be preserved and added to the subword list. Default is false.

ProtectedWords

A list of tokens to protect from being delimited.

SplitOnCaseChange

A value indicating whether to split words on caseChange. For example, if this is set to true, "AzureSearch" becomes "Azure" "Search". Default is true.

SplitOnNumerics

A value indicating whether to split on numbers. For example, if this is set to true, "Azure1Search" becomes "Azure" "1" "Search". Default is true.

StemEnglishPossessive

A value indicating whether to remove trailing "'s" for each subword. Default is true.

Applies to