|
MXVM 1.8.1
Virtual Machine, Compiler, and Pascal Frontend
|
Lexical scanner that tokenizes source text into typed tokens. More...
#include "string_buffer.hpp"#include <iostream>#include <optional>#include <string>#include <vector>

Go to the source code of this file.
Classes | |
| class | scan::Scanner |
| Lexical scanner that tokenizes source text. More... | |
| class | scan::ScanExcept |
| Exception thrown during scanning errors. More... | |
Namespaces | |
| namespace | scan |
Typedefs | |
| using | scan::TString = buffer::StringBuffer<char> |
| Default character string buffer. | |
| using | scan::StringType = buffer::StringBuffer<char>::string_type |
| Underlying string type. | |
| using | scan::TToken = token::Token<char> |
| Default token type. | |
| using | scan::TMap = token::TokenMap<char> |
| Default character classification map. | |
Functions | |
| std::ostream & | operator<< (std::ostream &out, const types::CharType &c) |
| Stream output operator for CharType. | |
| std::ostream & | operator<< (std::ostream &out, const types::TokenType &t) |
| Stream output operator for TokenType. | |
Lexical scanner that tokenizes source text into typed tokens.
Definition in file scanner.hpp.
| std::ostream & operator<< | ( | std::ostream & | out, |
| const types::CharType & | c ) |
Stream output operator for CharType.
| std::ostream & operator<< | ( | std::ostream & | out, |
| const types::TokenType & | t ) |
Stream output operator for TokenType.