Retrieval, embeddings and long context / Benchmark leaderboard
LongBench v2
Long-document comprehension and reasoning across realistic scenarios.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Multiple-choice accuracy across length and difficulty slices.
Execution requirements
Long-context model or declared retrieval-assisted setting.
Scope and limitations
Report retrieval use and context truncation; avoid comparing different input access conditions.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
- Dataset / catalog ↗
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Anthropic: Capability-aligned; adapter/access to qualify
Cohere: Direct component API + selected system adapters
Glean: Capability-aligned; adapter/access to qualify
Google DeepMind: Capability-aligned; adapter/access to qualify
Hebbia: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Writer: Capability-aligned; adapter/access to qualify