AnalyzedTokenInfo Class

Definition

Information about a token returned by an analyzer.

public class AnalyzedTokenInfo
type AnalyzedTokenInfo = class
Public Class AnalyzedTokenInfo
Inheritance
AnalyzedTokenInfo

Properties

EndOffset

The index of the last character of the token in the input text.

Position

The position of the token in the input text relative to other tokens. The first token in the input text has position 0, the next has position 1, and so on. Depending on the analyzer used, some tokens might have the same position, for example if they are synonyms of each other.

StartOffset

The index of the first character of the token in the input text.

Token

The token returned by the analyzer.

Applies to