Speech synthesis and voice cloning / Benchmark leaderboard
Open TTS Leaderboard
Listener preferences for generated speech samples.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Human preference/vote outcomes under the leaderboard protocol.
Execution requirements
TTS audio samples and the specified listening comparison.
Scope and limitations
A human-evaluation surface, not a deterministic offline dataset; useful complement to Seed intelligibility/similarity metrics.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Newer human-preference complement
- Dataset / catalog ↗
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Cartesia: TTS API; full cloning protocol conditional
Deepgram: Capability-aligned; adapter/access to qualify
ElevenLabs: TTS API; full cloning protocol conditional
Fish Audio: TTS API; full cloning protocol conditional
Hume AI: Capability-aligned; adapter/access to qualify
Murf AI: TTS API; full cloning protocol conditional
Resemble AI: TTS API; full cloning protocol conditional
Speechify: TTS API; full cloning protocol conditional
WellSaid: Capability-aligned; adapter/access to qualify