Share via


LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString Method

Definition

Overloads

TokenizeString(String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

TokenizeString(SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

TokenizeString(String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (string content);
abstract member TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
Public Overridable Function TokenizeString (content As String) As IEnumerable(Of TSymbol)

Parameters

content
String

The string to tokenize.

Returns

IEnumerable<TSymbol>

The collection of token.

Applies to

TokenizeString(SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (System.Web.Razor.Text.SourceLocation start, string input);
abstract member TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
Public Iterator Overridable Function TokenizeString (start As SourceLocation, input As String) As IEnumerable(Of TSymbol)

Parameters

start
SourceLocation

The source location as the start marker for the tokenizer.

input
String

The string to tokenize.

Returns

IEnumerable<TSymbol>

The collection of token.

Applies to