Document parsing and extraction / Benchmark leaderboard
ExtractBench
Schema-driven document extraction with page/bounding-box evidence.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Value correctness, completeness, schema compliance and grounding.
Execution requirements
Structured extraction API returning schema-valid JSON and evidence.
Scope and limitations
An OCR-only endpoint needs an extraction layer; plain text output cannot satisfy all evidence requirements.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Newer specialist
- Hugging Face · llamaindex/ExtractBench ↗Public · Selected structured document extraction suite.
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
ABBYY: Direct document API after output mapping
Extend: Direct document API after output mapping
Instabase: Direct document API after output mapping
LlamaIndex: Direct document API after output mapping
Mistral: Capability-aligned; adapter/access to qualify
Reducto: Direct document API after output mapping
Rossum: Direct document API after output mapping
Unstructured: Direct document API after output mapping