Container for token data and metadata. More...
#include <lexer.h>
Public Attributes | |
char * | val |
tok_e | typ |
size_t | ln |
size_t | col |
Container for token data and metadata.
Stores the complete information about a single token including:
size_t tok_t::col |
Starting column position (1-indexed)
size_t tok_t::ln |
Source line number (1-indexed)
char* tok_t::val |
Token string value (dynamically allocated)