Leaderboard / Benchmark directory
Browse by capability, company fit, or source catalog. Benchmarks with published results open their leaderboard; the rest open their catalog page.
Catalog snapshot: 2026-09-15. Exact source matches are joined; versions and ports remain distinct. This includes every entry reviewed in our research, not every dataset on Hugging Face. Catalog inclusion and company fit do not imply a hosted integration or a measured result.
6 benchmarks with results
Realistic manufacturing decisions framed as high-level employee requests. Agents must discover the relevant Oracle Fusion, Gmail, Drive, Sheets, and Slack evidence, reconcile records, calculate and compare options, then execute only the supported outcome.
Browser-only correlated SaaS work over deterministic populated worlds: find the right record among look-alikes, carry ids, dates and amounts across applications, obey the policy or capacity that gates an action, and record a structured decision — graded executably against the application backends.
One suite per System One use-case family (workflow control, retrieval and knowledge, safety and quality, data and operations, real-time and agents) across 16 industry verticals: yes/no, choice and ordinal-score decisions on public labelled data and seeded generators, scored as calibrated probabilities.
Fetch APIs on generated pages behind real-web friction (heavy chrome, consent overlays, client-side rendering, late content, tables): does the returned text contain the page's content, and how much else?
Search APIs asked for dated documents by the words a person would type (arXiv papers submitted days, a month and a year before the run): is the document in the top results, and how fresh is the index?
Web agents given one-line human requests, each needing one UI mechanic (52 distinct: sliders, native date and time fields, iframes, shadow DOM, hover and context menus, blocking dialogs, virtualised lists, drag and drop, typeahead, canvas controls, sign-in …); the server checks the state the agent submitted.
