DiffusionGemma: parallel text generation from scratch in PyTorch

A researcher shared DiffusionGemma, explaining how a diffusion language model generates text in parallel and implementing it from scratch in PyTorch, exploring non-autoregressive text generation.

• Foundation Model Engineering textbook2026-09-14
• OpenArch — PyTorch implementations of modern LLM architectures2026-09-14
• OpenUI releases OUI-1 UI model2026-09-11
• Advice for hobbyists: don’t let FOMO drive local LLM spending2026-09-09