AI
Teaching Transformers to Understand Numbers (for Real)
Large language models can ace math benchmarks yet still stumble on simple number sense because they treat numbers like ordinary words. This work fixes that by giving models a value-aware way to read numbers. How it works: whenever a number appears, the input is augmented with a tiny prefix token