Container for token data and metadata. More...
#include <lexer.h>
Public Attributes | |
| char * | val |
| tok_e | typ |
| size_t | ln |
| size_t | col |
Container for token data and metadata.
Stores the complete information about a single token including:
| size_t tok_t::col |
Starting column position (1-indexed)
| size_t tok_t::ln |
Source line number (1-indexed)
| char* tok_t::val |
Token string value (dynamically allocated)