LanguageCharacteristics<TTokenizer,TSymbol,TSymbolType>.CreateTokenizer Method
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code. Creates a Razor code language tokenizer for the specified source document.
public abstract TTokenizer CreateTokenizer (System.Web.Razor.Text.ITextDocument source);
abstract member CreateTokenizer : System.Web.Razor.Text.ITextDocument -> 'okenizer
Public MustOverride Function CreateTokenizer (source As ITextDocument) As TTokenizer
Parameters
- source
- ITextDocument
The source document.
Returns
TTokenizer
A Razor code language tokenizer for the specified source document.