The A.I. Daily
CWE-bench v2 releases 100 security tasks
Collinear AI released CWE-bench v2, a public set of 100 tasks covering 91 CWE types that tests agents on finding and fixing vulnerabilities in real open-source repos without breaking functionality. Scoring is fully programmatic and reproducible, and a held-out set tracks progress on tasks no model has seen.