348M model trained on 22.7B tokens solves arithmetic

A researcher trained a 348M‑parameter language model on 22.7B tokens and fine‑tuned it to produce worked steps for arithmetic, achieving a 99.4% average on nine GPT‑3 arithmetic sub‑tasks (n=300, greedy, exact match) and cleanly handling addition up to 14 digits; the author attributes earlier limits to vocabulary, not arithmetic ability.

• The 2026 Inference Hardware Revolution2026-09-15
• Mathematical framework for transformer circuits2026-09-12