NormalizedString Struct

Definition

Namespace:

Microsoft.ML.Tokenizers

Assembly:

Microsoft.ML.Tokenizers.dll

Package:

Microsoft.ML.Tokenizers v0.21.1

Contains the normalized string and the mapping to the original string.

public readonly struct NormalizedString

type NormalizedString = struct

Public Structure NormalizedString

Inheritance

ValueType

NormalizedString

Constructors

NormalizedString(String, String, Int32[], Boolean)

Create NormalizedString object containing the normalization of the original string and the mapping between the original and the normalized string.

Properties

CanMapToOriginal	Gets whether can map the normalized string the original string.
IsOneToOneMapping	Gets whether the normalization between the normalized string and the original string is one-to-one.
Normalized	Gets the normalized string.
NormalizedToOriginalMapping	Gets the mapping between the normalized string and the original string.
Original	Gets the original string before the normalization.