clang 19.0.0git
|
Re-lexes a sequence of tok::text tokens. More...
Public Member Functions | |
TextTokenRetokenizer (llvm::BumpPtrAllocator &Allocator, Parser &P) | |
bool | lexWord (Token &Tok) |
Extract a word – sequence of non-whitespace characters. | |
bool | lexDelimitedSeq (Token &Tok, char OpenDelim, char CloseDelim) |
void | putBackLeftoverTokens () |
Put back tokens that we didn't consume. | |
Re-lexes a sequence of tok::text tokens.
Definition at line 30 of file CommentParser.cpp.
|
inline |
Definition at line 146 of file CommentParser.cpp.
References P.
|
inline |
Definition at line 186 of file CommentParser.cpp.
References clang::C, memcpy(), and Text.
Referenced by clang::comments::Parser::parseParamCommandArgs().
Extract a word – sequence of non-whitespace characters.
Definition at line 153 of file CommentParser.cpp.
References clang::C, clang::isWhitespace(), memcpy(), and Text.
Referenced by clang::comments::Parser::parseCommandArgs(), clang::comments::Parser::parseParamCommandArgs(), and clang::comments::Parser::parseTParamCommandArgs().
|
inline |
Put back tokens that we didn't consume.
Definition at line 233 of file CommentParser.cpp.
References P.
Referenced by clang::comments::Parser::parseBlockCommand(), and clang::comments::Parser::parseInlineCommand().