Customer service and tool use / Benchmark leaderboard
AppWorld
Personal-assistant workflows spanning simulated applications and programmatic APIs.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Task goal completion and unintended-change checks.
Execution requirements
AppWorld runtime plus interactive code/tool agent.
Scope and limitations
Map tools into the simulated apps; access to a real SaaS connector does not make the product directly runnable.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Established
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Composio: Composite system
Gumloop: Capability-aligned; adapter/access to qualify
Lindy: Capability-aligned; adapter/access to qualify
OpenAI: Capability-aligned; adapter/access to qualify
Salesforce: Product-specific adapter / qualified access
Zapier: Capability-aligned; adapter/access to qualify
n8n: Capability-aligned; adapter/access to qualify