Customer service and tool use / Benchmark leaderboard
Toolathlon-Verified
108 verified long-horizon tasks across real software tool environments.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Task-specific outcome verification.
Execution requirements
Release-specific tools, apps and agent adapter.
Scope and limitations
Gated dataset and environment dependencies require setup; evaluate the verified task release, not an arbitrary older copy.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Newer specialist
- Hugging Face · hkust-nlp/Toolathlon ↗Gated · Selected verified long-horizon tool-use suite; gated.
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Composio: Composite system
Glean: Capability-aligned; adapter/access to qualify
Gumloop: Capability-aligned; adapter/access to qualify
Lindy: Capability-aligned; adapter/access to qualify
Salesforce: Product-specific adapter / qualified access
Zapier: Capability-aligned; adapter/access to qualify
n8n: Capability-aligned; adapter/access to qualify