LanguageCharacteristics<TTokenizer, TSymbol, TSymbolType>.TokenizeString Method (SourceLocation, String)

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Splits the specified string into tokens.

Namespace:  System.Web.Razor.Parser
Assembly:  System.Web.Razor (in System.Web.Razor.dll)

Syntax

'Declaration
Public Overridable Function TokenizeString ( _
    start As SourceLocation, _
    input As String _
) As IEnumerable(Of TSymbol)
'Usage
Dim instance As LanguageCharacteristics 
Dim start As SourceLocation 
Dim input As String 
Dim returnValue As IEnumerable(Of TSymbol)

returnValue = instance.TokenizeString(start, _
    input)

public virtual IEnumerable<TSymbol> TokenizeString(
    SourceLocation start,
    string input
)

public:
virtual IEnumerable<TSymbol>^ TokenizeString(
    SourceLocation start, 
    String^ input
)

abstract TokenizeString : 
        start:SourceLocation * 
        input:string -> IEnumerable<'TSymbol> 
override TokenizeString : 
        start:SourceLocation * 
        input:string -> IEnumerable<'TSymbol> 

public function TokenizeString(
    start : SourceLocation, 
    input : String
) : IEnumerable<TSymbol>

Parameters

• start
  Type: System.Web.Razor.Text.SourceLocation
  The source location as the start marker for the tokenizer.

• input
  Type: System.String
  The string to tokenize.

Return Value

Type: System.Collections.Generic.IEnumerable<TSymbol>
The collection of token.

See Also

Reference

LanguageCharacteristics<TTokenizer, TSymbol, TSymbolType> Class

TokenizeString Overload

System.Web.Razor.Parser Namespace