Customer service and tool use / Benchmark leaderboard
τ-bench / τ²-bench
Policy-following conversations, tool actions and cooperative customer-service tasks.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Task success and pass^k consistency across repeated runs.
Execution requirements
Agent linked to benchmark tools and a fixed user simulator.
Scope and limitations
pass^k measures consistent success and is not pass@k. Pin user simulator, policy version and turn limits.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established comparison family
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Ada: Capability-aligned; adapter/access to qualify
Decagon: Capability-aligned; adapter/access to qualify
Forethought: Capability-aligned; adapter/access to qualify
Intercom: Capability-aligned; adapter/access to qualify
Salesforce: Product-specific adapter / qualified access
ServiceNow: Product-specific adapter / qualified access
Sierra: Capability-aligned; adapter/access to qualify
Zendesk: Capability-aligned; adapter/access to qualify