← Benchmark deep diveAll leaderboards

Online-Mind2Web (GitHub snapshot pilot) · agent evaluation

The work behind the score

Inspect a task.

Original instructions, observed actions, and the verdict for each attempt.

Execution error

gpt-6-astra · 335.4s · 15 recorded actions

Original task

Search for a new internal M2 Samsung SSD drive between $25 and $200.

Grading criteria & verdicts

Executable checksUngraded

Recorded benchmark evaluator · not-configured

Evaluator was not configured

Rubric reviewUngraded

gpt-6-astra · browser-dom-constraints-v1

RuntimeError: Server error '502 Bad Gateway' for url 'http://10.40.192.188:8765/solve' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/502

Screenshot reviewUngraded

gpt-6-astra · browser-uniform-eight-frames-v1

RuntimeError: Server error '502 Bad Gateway' for url 'http://10.40.192.188:8765/solve' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/502