LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.TokenizeString Method

Definition

Namespace:

System.Web.Razor.Parser

Assembly:

System.Web.Razor.dll

Package:

Microsoft.AspNet.Razor v3.2.6

Overloads

TokenizeString(String)	This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.
TokenizeString(SourceLocation, String)	This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

TokenizeString(String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (string content);

abstract member TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>

Public Overridable Function TokenizeString (content As String) As IEnumerable(Of TSymbol)

Parameters

content

String

The string to tokenize.

Returns

IEnumerable<TSymbol>

The collection of token.

TokenizeString(SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

public virtual System.Collections.Generic.IEnumerable<TSymbol> TokenizeString (System.Web.Razor.Text.SourceLocation start, string input);

abstract member TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>
override this.TokenizeString : System.Web.Razor.Text.SourceLocation * string -> seq<'Symbol (requires 'Symbol :> System.Web.Razor.Tokenizer.Symbols.SymbolBase<'SymbolType>)>

Public Iterator Overridable Function TokenizeString (start As SourceLocation, input As String) As IEnumerable(Of TSymbol)

Parameters

start

SourceLocation

The source location as the start marker for the tokenizer.

input

String

The string to tokenize.

Returns

IEnumerable<TSymbol>

The collection of token.