Skip to content

Browser automation

Online-Mind2Web

300 real-world tasks spanning 136 websites; maintainers update invalid tasks.

About Online-Mind2Web

What it measures

Task success under the pinned evaluation protocol; human review or specified WebJudge.

Scope & limitations

Pin updated task IDs and evaluator. It is different from offline Mind2Web and Mind2Web 2.

Evaluation environment

Live browser, action/screenshot trace and dated task snapshot.

Source

Original benchmark

Dataset & task catalog ↗