Share via


VBTokenizer Class

This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.

Allows an application to break a VB symbol into tokens.

Inheritance Hierarchy

System.Object
  System.Web.Razor.StateMachine<VBSymbol>
    System.Web.Razor.Tokenizer.Tokenizer<VBSymbol, VBSymbolType>
      System.Web.Razor.Tokenizer.VBTokenizer

Namespace:  System.Web.Razor.Tokenizer
Assembly:  System.Web.Razor (in System.Web.Razor.dll)

Syntax

'Declaration
Public Class VBTokenizer _
    Inherits Tokenizer(Of VBSymbol, VBSymbolType)
'Usage
Dim instance As VBTokenizer
public class VBTokenizer : Tokenizer<VBSymbol, VBSymbolType>
public ref class VBTokenizer : public Tokenizer<VBSymbol^, VBSymbolType>
type VBTokenizer =  
    class 
        inherit Tokenizer<VBSymbol, VBSymbolType>
    end
public class VBTokenizer extends Tokenizer<VBSymbol, VBSymbolType>

The VBTokenizer type exposes the following members.

Constructors

  Name Description
Public method VBTokenizer This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Initializes a new instance of the VBTokenizer class.

Top

Properties

  Name Description
Protected property Buffer This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets or sets the buffer for the tokenizer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property CurrentCharacter This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the current character in the tokenizer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property CurrentErrors This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets a list of the current razor errors. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property CurrentLocation This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the current source location. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property CurrentStart This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the current start of the source location. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property CurrentState This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets or sets the current state of the machine. (Inherited from StateMachine<TReturn>.)
Protected property EndOfFile This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets a value whether the tokenizer current location is at the end of the file. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property HaveContent This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets a value whether the tokenizer have content. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Public property RazorCommentStarType This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the VB symbol type. (Overrides Tokenizer<TSymbol, TSymbolType>.RazorCommentStarType.)
Public property RazorCommentTransitionType This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the transition style of the VB symbol. (Overrides Tokenizer<TSymbol, TSymbolType>.RazorCommentTransitionType.)
Public property RazorCommentType This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the razor type comment of the VBSymbolType. (Overrides Tokenizer<TSymbol, TSymbolType>.RazorCommentType.)
Public property Source This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the source of the text document. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected property StartState This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Gets the start state of the machine. (Overrides StateMachine<TReturn>.StartState.)

Top

Methods

  Name Description
Protected method AfterRazorCommentTransition This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Returns a result after the razor comment transition. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method At This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Determines whether the lookahead buffer contains the expected string. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method CharOrWhiteSpace Returns a function delegate, that accepts a character parameter and returns a value that indicates whether the character parameter is equal to specified character or white space. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method CreateSymbol This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Creates a domain of symbols. (Overrides Tokenizer<TSymbol, TSymbolType>.CreateSymbol(SourceLocation, String, TSymbolType, IEnumerable<RazorError>).)
Protected method EndSymbol(TSymbolType) This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Returns the language end symbol type used by the tokenizer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method EndSymbol(SourceLocation, TSymbolType) This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Returns the language end symbol type used by the tokenizer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Public method Equals (Inherited from Object.)
Protected method Finalize (Inherited from Object.)
Public method GetHashCode (Inherited from Object.)
Public method GetType (Inherited from Object.)
Protected method MemberwiseClone (Inherited from Object.)
Protected method MoveNext This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Reads to the next character from the code reader. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Public method NextSymbol This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Shows the next symbol to be used. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method Peek This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Reads the next symbol in the code. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method RazorCommentBody This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Parses the Razor comment body. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Public method Reset This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Sets the tokenizer status to its initial state. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method ResumeSymbol This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Resumes using the previous language symbol type. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method Single This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Uses a single type of symbol. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method StartSymbol This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Returns the start symbol used in this class. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method Stay() This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Stays into the machine during the transition. (Inherited from StateMachine<TReturn>.)
Protected method Stay(TReturn) This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Stays into the machine during the transition with the specified output. (Inherited from StateMachine<TReturn>.)
Protected method Stop This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Disables the machine upon transition. (Inherited from StateMachine<TReturn>.)
Protected method TakeAll This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Takes the string if found in the lookahead buffer into the tokenizer buffer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method TakeCurrent This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Accepts the current character into the buffer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method TakeString This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Accepts the given input string into the buffer. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Protected method TakeUntil Parses the source document until the condition specified by predicate is met or end file is reached. (Inherited from Tokenizer<TSymbol, TSymbolType>.)
Public method ToString (Inherited from Object.)
Protected method Transition(StateMachine<TReturn>.State) This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Indicates the new transition of the state. (Inherited from StateMachine<TReturn>.)
Protected method Transition(TReturn, StateMachine<TReturn>.State) This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Indicates the new transition of the state with the specified output. (Inherited from StateMachine<TReturn>.)
Protected method Turn This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Describes the turning process of the state. (Inherited from StateMachine<TReturn>.)

Top

Explicit Interface Implementations

  Name Description
Explicit interface implemetationPrivate method ITokenizer.NextSymbol This type/member supports the .NET Framework infrastructure and is not intended to be used directly from your code.Returns the next language symbol type. (Inherited from Tokenizer<TSymbol, TSymbolType>.)

Top

Thread Safety

Any public static (Shared in Visual Basic) members of this type are thread safe. Any instance members are not guaranteed to be thread safe.

See Also

Reference

System.Web.Razor.Tokenizer Namespace