Scientific and ML agents / Benchmark leaderboard
BixBench
Bioinformatics analysis using data capsules.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Analysis-answer correctness under the chosen answer setting.
Execution requirements
Python/R-capable scientific agent and per-task data.
Scope and limitations
Use corrected post-September-2025 tasks and report open-answer versus multiple-choice settings.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established newer specialist
- Harbor · futurehouse/bixbench ↗205 source tasks · Public · Public detail metadata + family research
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Databricks: Capability-aligned; adapter/access to qualify
FutureHouse: Capability-aligned; adapter/access to qualify
Google DeepMind: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Sakana AI: Capability-aligned; adapter/access to qualify