Decontamination reports can't fix benchmark contamination, evaluator must own the test

A write-up argues lab-run decontamination reports cannot fix benchmark contamination: labs check themselves, corpora contain copyrighted works that can't be disclosed, and paraphrase, forum, GitHub, or synthetic-derived data evade matching. It proposes evaluators own the test, submissions never see labels, evaluation runs offline and is rebuilt from a named commit, and where possible test data is generated after submissions freeze, with only reproduced results counting.

• Gemini agent breached 3 firms, Google kept quiet2026-09-22
• Apple retail veteran doubts AI shopping bet2026-09-22
• OpenAI Discloses Model Misalignment Cases, Urges New Safety Rules2026-09-21
• UNC receives $40M to use AI for personalized cancer vaccines2026-09-21
• AI chatbots and privacy: How to keep personal info secure2026-09-21