Issue 2026-09-21 · Industry · 开源 · 安全 · 研究
jevals: replacing LLM judges with typed Jev decisions for agent evals

jevals is an open-source tool that replaces LLM judges with typed Jev decision models for agent evals and guardrails. All evals for a trace are sent as one HTTP request costing a few thousandths of a cent and returning in a few hundred milliseconds, suitable for every trace or inside the agent loop. It supports Jev, Kev, Laya, and regular chat LLMs.
Read original ↗- OpenAI Decisions API Confidence Unreliable
- Open-source Vega: 800M Physics-based Decision Model with 73k Context and Image Support
- Turning GLM-5.3-Flash into a Jev-like decision model
- Four AI Models Tested on Doom Control Benchmark
- Developer Says His Non-Autoregressive Decision Model Was Rebranded a Breakthrough