clang  9.0.0svn
Public Member Functions | List of all members
clang::ast_matchers::dynamic::Parser::CodeTokenizer Class Reference

Simple tokenizer for the parser. More...

Public Member Functions

 CodeTokenizer (StringRef MatcherCode, Diagnostics *Error)
 CodeTokenizer (StringRef MatcherCode, Diagnostics *Error, unsigned CodeCompletionOffset)
const TokenInfopeekNextToken () const
 Returns but doesn't consume the next token. More...
TokenInfo consumeNextToken ()
 Consumes and returns the next token. More...
TokenInfo::TokenKind nextTokenKind () const

Detailed Description

Simple tokenizer for the parser.

Definition at line 66 of file Parser.cpp.

Constructor & Destructor Documentation

◆ CodeTokenizer() [1/2]

clang::ast_matchers::dynamic::Parser::CodeTokenizer::CodeTokenizer ( StringRef  MatcherCode,
Diagnostics Error 

Definition at line 68 of file Parser.cpp.

◆ CodeTokenizer() [2/2]

clang::ast_matchers::dynamic::Parser::CodeTokenizer::CodeTokenizer ( StringRef  MatcherCode,
Diagnostics Error,
unsigned  CodeCompletionOffset 

Definition at line 73 of file Parser.cpp.

Member Function Documentation

◆ consumeNextToken()

TokenInfo clang::ast_matchers::dynamic::Parser::CodeTokenizer::consumeNextToken ( )

Consumes and returns the next token.

Definition at line 84 of file Parser.cpp.

◆ nextTokenKind()

TokenInfo::TokenKind clang::ast_matchers::dynamic::Parser::CodeTokenizer::nextTokenKind ( ) const

◆ peekNextToken()

const TokenInfo& clang::ast_matchers::dynamic::Parser::CodeTokenizer::peekNextToken ( ) const

Returns but doesn't consume the next token.

Definition at line 81 of file Parser.cpp.

Referenced by clang::ast_matchers::dynamic::Parser::parseExpression().

The documentation for this class was generated from the following file: