Issue 2026-09-25 · Industry · 开源 · 研究

Laya adds OpenVINO support: 40 ms per question on CPU

Developer Rupesh added OpenVINO support to Laya, achieving 40 ms per question on CPU, 3.4x faster than PyTorch. The project is open-sourced on GitHub with a Flappy Bird demo.

r/LocalLLaMA3 d ago
Read original ↗