WebVoyager

Run

webvoyager-browser-use-20260915-vision-20260916:browser-use-v4

Model

gpt-5.6-luna

Environment

Browser Use Cloud v4; fresh hosted browser per task; US proxy

Task budget

300s/task; $1.0 agent cap/task; one accepted run per task

Primary evaluator

rubric

Benchmark version

5a7896738c10bfb8b9edccce6bb0e0411f8ae569:69b19fd86c23f1a500244a3724e039aa7ca6a1223d03e11eb10e308d4f11c488

Evaluation

Primary: rubric; declared grading contract 82db14ea2dc5d3458d75a485c7de1eb4eefad97fca0871ea20146a4c8f0cb006

Imported recorded evidence; not independently rerun by the report engine. Scaffold: browser-use-cloud-v4 at SDK 3.11.3. Unknown measurements remain unknown. 15/643 tasks; one per website, seed 20260915. Separate Codex AI evidence review, not official GPT-4V grading or human adjudication; review model version was not retained. Unverified requirements receive no success credit under the recorded rubric. A later, separate Astra vision review runs on GKE using only the final screenshot and answer. Its restricted evidence scope is supplemental and does not replace the original rubric primary. Vision latency and subscription token usage are recorded separately; no dollar cost is inferred. Provider trajectory judgments are retained separately. Latency measures create-to-terminal agent time. Cost is final provider-reported run cost including asynchronous judge updates; browser hosting is separate. Original fixed dates were preserved.

Imported recorded evidence; not independently rerun by the report engine. Scaffold: browser-use-cloud-v4 at SDK 3.11.3. Unknown measurements remain unknown. 15/643 tasks; one per website, seed 20260915. Separate Codex AI evidence review, not official GPT-4V grading or human adjudication; review model version was not retained. Unverified requirements receive no success credit under the recorded rubric. A later, separate Astra vision review runs on GKE using only the final screenshot and answer. Its restricted evidence scope is supplemental and does not replace the original rubric primary. Vision latency and subscription token usage are recorded separately; no dollar cost is inferred. Provider trajectory judgments are retained separately. Latency measures create-to-terminal agent time. Cost is final provider-reported run cost including asynchronous judge updates; browser hosting is separate. Original fixed dates were preserved.