Measured pilot · September 16, 2026 UTC
Browser Use.
Fifteen real web tasks.
One fresh browser per task. The original instructions. Every answer and the reasoning behind its review.
What this establishes. A measured Browser Use Cloud v4 pilot using gpt-5.6-luna. The provider’s trajectory judge passed 12/15; a separate Codex evidence review supported 10/15. The report preserves both judgments and their disagreement.
How to read the result. Four tasks did not meet the original request and one material requirement could not be verified. The recorded rubric assigns no success credit to that unverified requirement. Two tasks still request travel dates in 2024. This pilot is not a full-suite score, competitor ranking, official WebVoyager GPT-4V evaluation or human adjudication.
Measured cost. $0.588206 in final provider-reported run costs, including asynchronous provider judging; $0.012333 in separately reported browser hosting. The supervising review’s cost was not measured. Vision grading used a subscription account; its token usage is retained without estimating a dollar cost.
The browser pilot was not rerun. The original outputs and rubric review are preserved; the new vision receipts are published as a dated supplement. Native execution grading remains unconfigured. Original publication manifest ↗
Task results
Every task, in detail.
Open any row for its instructions, agent output and evaluation reasons. Status describes execution; each evaluator has its own verdict.
15 of 15 task records · showing 1–15
| Browser Use v4 · Allrecipes | Fail | Pass | Not configured | 41.5s | Not recorded | Completed |
|---|---|---|---|---|---|---|
| Browser Use v4 · Amazon | Fail | Fail | Not configured | 102.3s | Not recorded | Completed |
| Browser Use v4 · Apple | Fail | Pass | Not configured | 92.2s | Not recorded | Completed |
| Browser Use v4 · ArXiv | Pass | Pass | Not configured | 101.1s | Not recorded | Completed |
| Browser Use v4 · BBC News | Fail | Pass | Not configured | 182.3s | Not recorded | Completed |
| Browser Use v4 · Booking | Fail | Fail | Not configured | 202.2s | Not recorded | Completed |
| Browser Use v4 · Cambridge Dictionary | Pass | Pass | Not configured | 30.5s | Not recorded | Completed |
| Browser Use v4 · Coursera | Fail | Pass | Not configured | 122.0s | Not recorded | Completed |
| Browser Use v4 · ESPN | Fail | Fail | Not configured | 60.7s | Not recorded | Completed |
| Browser Use v4 · GitHub | Fail | Fail | Not configured | 111.2s | Not recorded | Completed |
| Browser Use v4 · Google Flights | Fail | Fail | Not configured | 164.1s | Not recorded | Completed |
| Browser Use v4 · Google Map | Pass | Pass | Not configured | 50.5s | Not recorded | Completed |
| Browser Use v4 · Google Search | Fail | Pass | Not configured | 166.8s | Not recorded | Completed |
| Browser Use v4 · Huggingface | Fail | Pass | Not configured | 96.6s | Not recorded | Completed |
| Browser Use v4 · Wolfram Alpha | Fail | Pass | Not configured | 244.2s | Not recorded | Completed |