Issue 2026-10-31 · Industry · 研究 · 开源

FlashAttention kernel auto-derived from ~25 lines of SQL

FlashAttention kernel auto-derived from ~25 lines of SQL

A demo shows a FlashAttention kernel being automatically derived from roughly 25 lines of SQL expressing vanilla attention. It relies on three SQL extensions: xarray-sql, the JAX-style autodiff extension ddx, and the einfold query planner; the author argues relational algebra offers a better way to program accelerators.

Hacker News35 h ago
Read original ↗