Healthcare AI / Benchmark leaderboard
HealthBench
Health conversations graded against clinician-written criteria.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Rubric scores under the published model-based grader.
Execution requirements
Health conversational model plus reference evaluator.
Scope and limitations
For ambient scribes this is only an adjacent reasoning check; it does not evaluate transcription, note fidelity or EHR integration.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established newer specialist
- Dataset / catalog ↗
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Abridge: Product-specific adapter / qualified access
Ambience: Product-specific adapter / qualified access
Anthropic: Capability-aligned; adapter/access to qualify
Google DeepMind: Capability-aligned; adapter/access to qualify
Hippocratic AI: Product-specific adapter / qualified access
Nabla: Product-specific adapter / qualified access
OpenAI: Capability-aligned; adapter/access to qualify
Suki: Product-specific adapter / qualified access