Search and deep research / Benchmark leaderboard

BrowseComp

1,266 hard-to-find web information questions.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

Answer correctness under the original evaluator.

Execution requirements

Search/browsing agent with fixed budgets.

Scope and limitations

Measures persistent fact-finding; does not establish report quality, citation quality or transaction execution. Search APIs need a fixed agent wrapper.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Anthropic: Capability-aligned; adapter/access to qualify

Exa: Research endpoint or composite system

Glean: Capability-aligned; adapter/access to qualify

Google DeepMind: Capability-aligned; adapter/access to qualify

OpenAI: Capability-aligned; adapter/access to qualify

Parallel: Research endpoint or composite system

Perplexity: Capability-aligned; adapter/access to qualify

Tavily: Research endpoint or composite system

Writer: Capability-aligned; adapter/access to qualify

You.com: Research endpoint or composite system

Firecrawl: Conditional on qualifying the research-preview Agent as an answer-producing system; raw scraping alone does not qualify.