Issue 2026-10-10 · Industry · 研究

New O(NlogN) Attention System Retains 97% Long-Context Accuracy

A developer introduced ALHR, a static binary-tree attention system with learnable hierarchical routing that reduces the number of keys used. It cuts memory use and scales VRAM better with tokens while retaining 97% accuracy on the long-context MQAR task.

r/MachineLearning24 d ago
Read original ↗