Issue 2026-09-12 · Industry · 研究
Mathematical framework for transformer circuits
The 2021 paper proposes a mathematical framework for mechanistic interpretability of transformers, starting with simple two-layer attention-only models to identify algorithmic motifs that could scale to larger models and help explain or predict safety-relevant behaviors.
Read original ↗