Loop Transformer

On Loop and Recursive Transformers

The author examines Loop Transformers and favors a recursive variant, critiquing weight-reuse loops and exploring ties to chain-of-thought, composable context, and recursive self-improvement architectures.