Laya

12 stories

Laya is an open-source decision model with 421M parameters, first released in March 2025 with an arXiv paper, Hugging Face weights and an open dataset, built around non-autoregressive decisions and sub-35ms latency. Recent coverage focuses on how it performs in practice: it was the fastest of four models benchmarked on an RTX 4090 at 3.9 ms per word with 97.4% accuracy, gained OpenVINO support for roughly 40 ms per question on CPU, and was tested in a Doom control benchmark and served by local decision servers such as Ollaya.

Related topics

Four open decision models benchmarked on an RTX 4090

A user benchmarked four new open decision models, Laya, d1 3B, Clef-Flash 9B and Lev 4B, on a single RTX 4090, tasking them to flag centipede names word by word across 9,534 words of Wikipedia text. Laya was fastest overall at 3.9 ms per word, about 7,980 words in 32 seconds and 97.4% accuracy; Lev was slowest but caught the most names.

r/LocalLLaMA ·

Turning GLM-5.3-Flash into a Jev-like decision model

A study crafts input prompts so the first output token answers the question, enabling standard LLMs such as GLM-5.3-Flash to make decisions in a single forward pass and reproduce Jev-like properties on vLLM. Benchmarks show accuracy and speed on par with Jev and substantially better than Laya, though cost per decision is several times higher than Jev; the setup also supports vision inputs.

Hacker News ·

Ollaya offers millisecond decision models

Ollaya is an open-source decision-model server for local hardware that answers in a single forward pass instead of token-by-token generation, handling a five-question request in about 10 ms. It exposes TypeSafe-compatible endpoints and works with the official Python SDK 0.7.1, shipping open models such as Laya, decider and nli.

Hacker News ·

Four AI Models Tested on Doom Control Benchmark

An experiment let Jev, Laya, finetuned ModernCE and finetuned Qwen3.5-4B play ViZDoom autonomously, comparing kills, survival time and latency. Finetuned Qwen3.5-4B averaged 3.63 kills, the best, while Jev survived 5.63s on average with p95 latency near 200ms. No model received Doom-specific training.

r/LocalLLaMA ·

Developer Says His Non-Autoregressive Decision Model Was Rebranded a Breakthrough

A developer says he released an RL-based non-autoregressive decision model, Laya, back in March 2025 via an arXiv paper, Hugging Face weights, and an open dataset—sub-35ms inference across 100+ languages. He criticizes frontier lab TypeSafe AI, founded by a former OpenAI member, for launching a similar product, Jev, in September 2026 as a brand-new breakthrough without papers, open weights, or training data.

Hacker News ·
That is everything