Customer service and tool use / Benchmark leaderboard
ToolSandbox
Stateful conversations with dependent tools and implicit contextual requirements.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Milestone / state-based task success.
Execution requirements
Adapter to benchmark tools and world state.
Scope and limitations
Requires preservation of state and tool semantics; generic chat-only evaluation is insufficient.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Anthropic: Capability-aligned; adapter/access to qualify
Apple: Product-specific adapter / qualified access
Composio: Composite system
Google DeepMind: Capability-aligned; adapter/access to qualify
Lindy: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Zapier: Capability-aligned; adapter/access to qualify