Issue 2026-10-17 · Industry · 开源 · 应用

Qwen3.8-27B runs on iPhone 18 Neural Engine at 1.5 bpw

An HN post reports Qwen3.8-27B running on the iPhone 18 Neural Engine at roughly 15–70 tokens per second after 1.5-bpw quantization. It highlights progress in on-device LLM inference, though hardware and quantization details need verification.

Hacker News33 h ago
Read original ↗