clang 19.0.0git
Classes | Public Member Functions | List of all members
clang::comments::TextTokenRetokenizer Class Reference

Re-lexes a sequence of tok::text tokens. More...

Public Member Functions

 TextTokenRetokenizer (llvm::BumpPtrAllocator &Allocator, Parser &P)
 
bool lexWord (Token &Tok)
 Extract a word – sequence of non-whitespace characters.
 
bool lexDelimitedSeq (Token &Tok, char OpenDelim, char CloseDelim)
 
void putBackLeftoverTokens ()
 Put back tokens that we didn't consume.
 

Detailed Description

Re-lexes a sequence of tok::text tokens.

Definition at line 30 of file CommentParser.cpp.

Constructor & Destructor Documentation

◆ TextTokenRetokenizer()

clang::comments::TextTokenRetokenizer::TextTokenRetokenizer ( llvm::BumpPtrAllocator &  Allocator,
Parser P 
)
inline

Definition at line 146 of file CommentParser.cpp.

References P.

Member Function Documentation

◆ lexDelimitedSeq()

bool clang::comments::TextTokenRetokenizer::lexDelimitedSeq ( Token Tok,
char  OpenDelim,
char  CloseDelim 
)
inline

Definition at line 186 of file CommentParser.cpp.

References clang::C, memcpy(), and Text.

Referenced by clang::comments::Parser::parseParamCommandArgs().

◆ lexWord()

bool clang::comments::TextTokenRetokenizer::lexWord ( Token Tok)
inline

Extract a word – sequence of non-whitespace characters.

Definition at line 153 of file CommentParser.cpp.

References clang::C, clang::isWhitespace(), memcpy(), and Text.

Referenced by clang::comments::Parser::parseCommandArgs(), clang::comments::Parser::parseParamCommandArgs(), and clang::comments::Parser::parseTParamCommandArgs().

◆ putBackLeftoverTokens()

void clang::comments::TextTokenRetokenizer::putBackLeftoverTokens ( )
inline

Put back tokens that we didn't consume.

Definition at line 233 of file CommentParser.cpp.

References P.

Referenced by clang::comments::Parser::parseBlockCommand(), and clang::comments::Parser::parseInlineCommand().


The documentation for this class was generated from the following file: