Issue 2026-09-12 · Industry · 研究

Mathematical framework for transformer circuits

The 2021 paper proposes a mathematical framework for mechanistic interpretability of transformers, starting with simple two-layer attention-only models to identify algorithmic motifs that could scale to larger models and help explain or predict safety-relevant behaviors.

Hacker News5 d ago
Read original ↗