Sebastian Raschka @rasbt

Inkling 2 Small took a while... but it's more interesting than I initially thought! Using attention residuals (like Kimi K3), but without the linear-attention hybrid. Food for discussion for the end-of-the-year architecture trends analysis! https://t.co/2U4ctJa1yw

X47 h ago
Read original ↗