▼Lexical Analyzer | Complete token handling system for source code analysis |
File I/O | File chunk handling utilities for lexical analysis |
Tokenization | Source code to token conversion |
Token Validation | Token validation functions for lexical analysis |
Token Classification | Token type definitions and classification utilities |
Token Structure | Token instance representation and operations |
Token Set | Collection of tokens and operations |