FrontierRSI:
Evaluating AI Models at Autonomous ML R&D
A benchmark of 15 open-ended ML R&D tasks. In each, an agent works for 12 hours in a virtual lab with GPUs, literature, datasets and a budget, develops its own evaluations, and submits a model or method that we grade on held-out assessments.
Coming soon