Issue 2026-11-01 · Industry · 开源 · 研究

Developer builds 8M-parameter LLM lab, asks about sharing

A developer built and trained an ~8M-parameter LLM from scratch in PyTorch as a lab for implementing research-paper ideas. Training ran 60,000 steps; next steps are KV caching, PagedAttention and Orca. He asked whether the community welcomes posts about these experiment blogs.

r/MachineLearning21 h ago
Read original ↗