Speech synthesis and voice cloning / Benchmark leaderboard

Seed-TTS-eval

Zero-shot TTS/voice conversion in English and Mandarin using reference audio.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

WER and speaker-similarity cosine score under the official ASR/embedding stack.

Execution requirements

Reference-conditioned TTS API; generate WAV/audio for the prescribed text.

Scope and limitations

Full protocol requires compatible reference clips and permitted cloning access. Deepgram/WellSaid stock voices cannot be assigned an equivalent speaker-cloning score; stock-voice WER is a separate adaptation.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Cartesia: TTS API; full cloning protocol conditional

ElevenLabs: TTS API; full cloning protocol conditional

Fish Audio: TTS API; full cloning protocol conditional

HeyGen: TTS API; full cloning protocol conditional

Murf AI: TTS API; full cloning protocol conditional

Resemble AI: TTS API; full cloning protocol conditional

Speechify: TTS API; full cloning protocol conditional

Synthesia: TTS API; full cloning protocol conditional