ATAP: Auditing Token Padding and Token Accounting in Large Language Models: A Constraint-Adherence Metric and a Multi-Provider Empirical Study
A preprint with Tobi Adeosun examining whether language models follow constraints and how different providers account for tokens, the units used to process and measure text.
Preprint · 2026