Browser automation / Benchmark leaderboard

WebArena

Multi-step commerce, forum, CMS and developer-site workflows in resettable websites.

No published company result yet.

This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.

Arrange an evaluation for your company →

What this benchmark measures

Metrics

Execution-based task success.

Execution requirements

Self-hosted sites plus BrowserGym or original harness.

Scope and limitations

Preserve original site data and resets; a live-web implementation is a different benchmark.

Evaluation availability

Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.

Sources and company fit

Companies whose products may fit

Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.

Compatibility notes for each company

Automation Anywhere: Product-specific adapter / qualified access

Browser Use: Capability-aligned; adapter/access to qualify

Browserbase / Stagehand: Capability-aligned; adapter/access to qualify

Firecrawl: Composite system

Microsoft Playwright: Composite system

Skyvern: Capability-aligned; adapter/access to qualify

Steel: Composite system

TinyFish: Capability-aligned; adapter/access to qualify

UiPath: Product-specific adapter / qualified access