Issue 2026-10-12 · Industry · 开源 · 模型发布

Project Maya Runs 321B-Parameter GLM-5.3-Flash on One GPU

Open-source Project Maya runs the 321B-parameter GLM-5.3-Flash locally on one NVIDIA GPU by tiering experts across GPU, RAM and SSD, reaching 30+ tokens/s and up to 118 tokens/s on four RTX 4090s while retaining 97.7-99.2% of FP8 zero-shot accuracy.

r/LocalLLaMA7 d ago
Read original ↗