Scientific and ML agents
RE-Bench
Autonomous AI research and engineering tasks with varying time budgets.
About RE-Bench
What it measures
Task-specific improvement normalized by the published methodology.
Scope & limitations
Small expert-designed suite; repeated exposure and resource differences can dominate comparisons.
Evaluation environment
Research coding environment and fixed compute/time limits.