In This Article

MergeableTokenReader Class

Represents an object that can provide tokens to a ILLParser in a forward-only direction for a IMergeableLexer.

public class MergeableTokenReader : TokenReaderBase, ITokenReader
Inheritance:
object TokenReaderBase object
Derived:
CSharpTokenReader JavaScriptTokenReader PythonTokenReader VBTokenReader XmlTokenReader
Implements:
ITokenReader

Constructors

MergeableTokenReader(ITextBufferReader, IMergeableLexer)

Represents an object that can provide tokens to a ILLParser in a forward-only direction for a IMergeableLexer.

public MergeableTokenReader(ITextBufferReader reader, IMergeableLexer rootLexer)
Parameter Type Description
reader ITextBufferReader

The ITextBufferReader to use for consuming text.

rootLexer IMergeableLexer

The root IMergeableLexer.

Methods

GetNextToken()

Returns the next IToken that will be consumed by the token reader.

protected override IToken? GetNextToken()

Returns

IToken

Pop()

Pops the top token reader state from the stack and restores the token reader to that state.

public override bool Pop()

Returns

bool:

true if a pop occurred; otherwise, false.

Push()

Pushes the token reader state onto a stack for later restoration, generally to begin a multiple token look-ahead operation.

public override void Push()

Remarks

Any call to this method must have a corresponding Pop() call.

Inherited Members

Extension Methods