MXVM 1.8.1
Virtual Machine, Compiler, and Pascal Frontend
Loading...
Searching...
No Matches
scanner.hpp File Reference

Lexical scanner that tokenizes source text into typed tokens. More...

#include "string_buffer.hpp"
#include <iostream>
#include <optional>
#include <string>
#include <vector>
Include dependency graph for scanner.hpp:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

class  scan::Scanner
 Lexical scanner that tokenizes source text. More...
class  scan::ScanExcept
 Exception thrown during scanning errors. More...

Namespaces

namespace  scan

Typedefs

using scan::TString = buffer::StringBuffer<char>
 Default character string buffer.
using scan::StringType = buffer::StringBuffer<char>::string_type
 Underlying string type.
using scan::TToken = token::Token<char>
 Default token type.
using scan::TMap = token::TokenMap<char>
 Default character classification map.

Functions

std::ostream & operator<< (std::ostream &out, const types::CharType &c)
 Stream output operator for CharType.
std::ostream & operator<< (std::ostream &out, const types::TokenType &t)
 Stream output operator for TokenType.

Detailed Description

Lexical scanner that tokenizes source text into typed tokens.

Author
Jared Bruni

Definition in file scanner.hpp.

Function Documentation

◆ operator<<() [1/2]

std::ostream & operator<< ( std::ostream & out,
const types::CharType & c )

Stream output operator for CharType.

◆ operator<<() [2/2]

std::ostream & operator<< ( std::ostream & out,
const types::TokenType & t )

Stream output operator for TokenType.