Skip to content

Customer service and tool use

AppWorld

Personal-assistant workflows spanning simulated applications and programmatic APIs.

About AppWorld

What it measures

Task goal completion and unintended-change checks.

Scope & limitations

Map tools into the simulated apps; access to a real SaaS connector does not make the product directly runnable.

Evaluation environment

AppWorld runtime plus interactive code/tool agent.

Source

Original benchmark