Scientific and ML agents / Benchmark leaderboard

LAB-Bench (FutureHouse)

Biology literature, database, figure and procedural-reasoning questions.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

Subtask answer accuracy.

Execution requirements

Science assistant with track-appropriate tools.

Scope and limitations

Different from Harvey LAB. The Harbor 181-task port is not the full upstream multi-subtask corpus.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Consensus: Capability-aligned; adapter/access to qualify

Elicit: Capability-aligned; adapter/access to qualify

FutureHouse: Capability-aligned; adapter/access to qualify

Google DeepMind: Capability-aligned; adapter/access to qualify

OpenAI: Capability-aligned; adapter/access to qualify