LuceneStandardTokenizerV2 Class

Package:

com.azure.search.documents.indexes.models

Maven Artifact:

com.azure:azure-search-documents:12.0.0

• java.lang.Object
• • com.azure.search.documents.indexes.models.LexicalTokenizer
  • • com.azure.search.documents.indexes.models.LuceneStandardTokenizerV2

public final class LuceneStandardTokenizerV2
extends LexicalTokenizer

Breaks text following the Unicode Text Segmentation rules. This tokenizer is implemented using Apache Lucene.

Constructor Summary

Constructor	Description
LuceneStandardTokenizerV2(String name)	Creates an instance of LuceneStandardTokenizerV2 class.

Method Summary

Modifier and Type	Method and Description
static LuceneStandardTokenizerV2	fromJson(JsonReader jsonReader) Reads an instance of LuceneStandardTokenizerV2 from the JsonReader.
Integer	getMaxTokenLength() Get the maxTokenLength property: The maximum token length.
String	getOdataType() Get the odataType property: The discriminator for derived types.
LuceneStandardTokenizerV2	setMaxTokenLength(Integer maxTokenLength) Set the maxTokenLength property: The maximum token length.
JsonWriter	toJson(JsonWriter jsonWriter)

Methods inherited from LexicalTokenizer

fromJson getName getOdataType toJson

Methods inherited from java.lang.Object

clone equals finalize getClass hashCode notify notifyAll toString wait wait wait

Constructor Details

LuceneStandardTokenizerV2

public LuceneStandardTokenizerV2(String name)

Creates an instance of LuceneStandardTokenizerV2 class.

Parameters:

name - the name value to set.

Method Details

fromJson

public static LuceneStandardTokenizerV2 fromJson(JsonReader jsonReader)

Reads an instance of LuceneStandardTokenizerV2 from the JsonReader.

Parameters:

jsonReader - The JsonReader being read.

Returns:

An instance of LuceneStandardTokenizerV2 if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.

Throws:

IOException

- If the deserialized JSON object was missing any required properties.

getMaxTokenLength

public Integer getMaxTokenLength()

Get the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split. The maximum token length that can be used is 300 characters.

Returns:

the maxTokenLength value.

getOdataType

public String getOdataType()

Get the odataType property: The discriminator for derived types.

Overrides:

LuceneStandardTokenizerV2.getOdataType()

Returns:

the odataType value.

setMaxTokenLength

public LuceneStandardTokenizerV2 setMaxTokenLength(Integer maxTokenLength)

Set the maxTokenLength property: The maximum token length. Default is 255. Tokens longer than the maximum length are split. The maximum token length that can be used is 300 characters.

Parameters:

maxTokenLength - the maxTokenLength value to set.

Returns:

the LuceneStandardTokenizerV2 object itself.

toJson

public JsonWriter toJson(JsonWriter jsonWriter)

Overrides:

LuceneStandardTokenizerV2.toJson(JsonWriter jsonWriter)

Parameters:

jsonWriter

Throws:

IOException