clang  10.0.0svn
Classes | Namespaces | Functions
Tokens.h File Reference
#include "clang/Basic/FileManager.h"
#include "clang/Basic/LangOptions.h"
#include "clang/Basic/SourceLocation.h"
#include "clang/Basic/SourceManager.h"
#include "clang/Basic/TokenKinds.h"
#include "clang/Lex/Token.h"
#include "llvm/ADT/ArrayRef.h"
#include "llvm/ADT/Optional.h"
#include "llvm/ADT/StringRef.h"
#include "llvm/Support/Compiler.h"
#include "llvm/Support/raw_ostream.h"
#include <cstdint>
#include <tuple>
Include dependency graph for Tokens.h:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

struct  clang::syntax::FileRange
 A half-open character range inside a particular file, the start offset is included and the end offset is excluded from the range. More...
 
class  clang::syntax::Token
 A token coming directly from a file or from a macro invocation. More...
 
class  clang::syntax::TokenBuffer
 A list of tokens obtained by preprocessing a text buffer and operations to map between the expanded and spelled tokens, i.e. More...
 
struct  clang::syntax::TokenBuffer::Expansion
 An expansion produced by the preprocessor, includes macro expansions and preprocessor directives. More...
 
class  clang::syntax::TokenCollector
 Collects tokens for the main file while running the frontend action. More...
 

Namespaces

 clang
 Dataflow Directional Tag Classes.
 
 clang::syntax
 

Functions

llvm::raw_ostream & clang::syntax::operator<< (llvm::raw_ostream &OS, const FileRange &R)
 For debugging purposes. More...
 
llvm::raw_ostream & clang::syntax::operator<< (llvm::raw_ostream &OS, const Token &T)
 For debugging purposes. Equivalent to a call to Token::str(). More...
 
std::vector< syntax::Token > clang::syntax::tokenize (FileID FID, const SourceManager &SM, const LangOptions &LO)
 Lex the text buffer, corresponding to FID, in raw mode and record the resulting spelled tokens. More...