Scientific and ML agents / Benchmark leaderboard
MLE-bench
Machine-learning engineering on Kaggle-derived competitions.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Competition scores / medal-level attainment under the official protocol.
Execution requirements
Dataset downloads, compute budget and training/code agent.
Scope and limitations
Heavy compute and competition-specific terms; the repository currently pauses new leaderboard submissions while revising fairness checks.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Anthropic: Capability-aligned; adapter/access to qualify
Databricks: Capability-aligned; adapter/access to qualify
Google DeepMind: Capability-aligned; adapter/access to qualify
NVIDIA: Research / simulator adaptation
OpenAI: Capability-aligned; adapter/access to qualify
Sakana AI: Capability-aligned; adapter/access to qualify