| ▼Lexical Analyzer | Complete token handling system for source code analysis |
| File I/O | File chunk handling utilities for lexical analysis |
| Tokenization | Source code to token conversion |
| Token Validation | Token validation functions for lexical analysis |
| Token Classification | Token type definitions and classification utilities |
| Token Structure | Token instance representation and operations |
| Token Set | Collection of tokens and operations |