FrontierRSI:
Evaluating AI Models at autonomous ML R&D
A benchmark of 20 open-ended ML R&D tasks. Each gives the agent a research goal and what a human researcher would have: GPUs, papers, datasets and infra, all under a budget.
Coming soon