The A.I. Daily
Stanford, Berkeley introduce TokenGate attention method
Researchers from Stanford and UC Berkeley introduce TokenGate, a token-gated attention mechanism that makes long-context prefill up to 11.3x faster, potentially reducing compute costs for long-text inference.