Conversational voice and audio understanding / Benchmark leaderboard
VoiceBench
Speech-input instruction following, reasoning and robustness to speaker/environment variation.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Subtask-specific accuracy / judge scores.
Execution requirements
Voice assistant with audio input and benchmark-compatible answers.
Scope and limitations
Not a replacement for telephone-network, full-duplex or transaction-success testing.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established specialist
- Dataset / catalog ↗
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Bland AI: Full voice-stack adapter
Cartesia: TTS API; full cloning protocol conditional
Cresta: Full voice-stack adapter
Deepgram: Capability-aligned; adapter/access to qualify
ElevenLabs: TTS API; full cloning protocol conditional
Google DeepMind: Capability-aligned; adapter/access to qualify
Hume AI: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Parloa: Full voice-stack adapter
PolyAI: Full voice-stack adapter
Retell AI: Full voice-stack adapter
Vapi: Full voice-stack adapter