clang  6.0.0svn
Classes | Public Member Functions | List of all members
clang::comments::TextTokenRetokenizer Class Reference

Re-lexes a sequence of tok::text tokens. More...

Public Member Functions

 TextTokenRetokenizer (llvm::BumpPtrAllocator &Allocator, Parser &P)
 
bool lexWord (Token &Tok)
 Extract a word – sequence of non-whitespace characters. More...
 
bool lexDelimitedSeq (Token &Tok, char OpenDelim, char CloseDelim)
 
void putBackLeftoverTokens ()
 Put back tokens that we didn't consume. More...
 

Detailed Description

Re-lexes a sequence of tok::text tokens.

Definition at line 31 of file CommentParser.cpp.

Constructor & Destructor Documentation

◆ TextTokenRetokenizer()

clang::comments::TextTokenRetokenizer::TextTokenRetokenizer ( llvm::BumpPtrAllocator &  Allocator,
Parser P 
)
inline

Definition at line 147 of file CommentParser.cpp.

Member Function Documentation

◆ lexDelimitedSeq()

bool clang::comments::TextTokenRetokenizer::lexDelimitedSeq ( Token Tok,
char  OpenDelim,
char  CloseDelim 
)
inline

Definition at line 187 of file CommentParser.cpp.

Referenced by clang::comments::Parser::parseParamCommandArgs().

◆ lexWord()

bool clang::comments::TextTokenRetokenizer::lexWord ( Token Tok)
inline

◆ putBackLeftoverTokens()

void clang::comments::TextTokenRetokenizer::putBackLeftoverTokens ( )
inline

Put back tokens that we didn't consume.

Definition at line 234 of file CommentParser.cpp.

Referenced by clang::comments::Parser::parseBlockCommand(), and clang::comments::Parser::parseInlineCommand().


The documentation for this class was generated from the following file: