Search and deep research / Benchmark leaderboard
FRAMES
Multi-hop factual retrieval and reasoning across source documents.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Answer accuracy, with reasoning-type slices.
Execution requirements
RAG/research pipeline with fixed retrieval conditions.
Scope and limitations
A useful diagnostic for synthesis, not proof of broad open-web coverage or private enterprise connector quality.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
- Dataset / catalog ↗
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Cohere: Direct component API + selected system adapters
Exa: Research endpoint or composite system
Glean: Capability-aligned; adapter/access to qualify
Hebbia: Capability-aligned; adapter/access to qualify
Parallel: Research endpoint or composite system
Perplexity: Capability-aligned; adapter/access to qualify
Tavily: Research endpoint or composite system
Vectara: Capability-aligned; adapter/access to qualify
Writer: Capability-aligned; adapter/access to qualify
You.com: Research endpoint or composite system