Issue 2026-10-06 · Industry · 研究 · 应用

SWE-Race benchmark tests coding agents on real concurrency bugs

Researchers built SWE-Race, a benchmark of 188 real concurrency bugs from merged PRs in about 100 Python projects, graded by each project's own tests in an offline container. With one attempt, GLM-5.3 Flash scored 85% and GPT-5.6 Luna 81%; simple tasks near 100%, with differences mainly on the harder half.

r/MachineLearning26 d ago
Read original ↗