Frontier models fail to match human algorithmic innovation in InnovationEval test

Researchers introduced InnovationEval, testing whether AI can independently discover novel ML techniques comparable to human innovations. Recent frontier models made little progress despite using thousands of dollars of GPU time. The end-to-end benchmark aims to track progress toward automating AI research itself.