Document parsing and extraction / Benchmark leaderboard
ChartQA
Visual and numerical reasoning about chart images.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Relaxed answer accuracy under the published protocol.
Execution requirements
Vision-language model or chart-aware document assistant.
Scope and limitations
Report human-written and generated question subsets; preserve chart resolution and access to underlying tables.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
ABBYY: Direct document API after output mapping
Extend: Direct document API after output mapping
Google DeepMind: Capability-aligned; adapter/access to qualify
Hebbia: Capability-aligned; adapter/access to qualify
Instabase: Direct document API after output mapping
LlamaIndex: Direct document API after output mapping
Mistral: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Reducto: Direct document API after output mapping
Rogo: Capability-aligned; adapter/access to qualify
Rossum: Direct document API after output mapping
Unstructured: Direct document API after output mapping