Software engineering / Benchmark leaderboard
APEX-SWE
200 integration and observability cases covering software construction and debugging with operational telemetry.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Task pass rate under the declared harness; expert rubrics and executable tests.
Execution requirements
Pinned software environments, task tools, unit tests and the publisher's evaluation harness.
Scope and limitations
The publisher releases 50 related cases; its 200-case leaderboard split stays private. The public subset cannot establish a full-suite score.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Publisher benchmark · full split requires access
- Publisher · Mercor APEX-SWE ↗200 source tasks · 50 public cases; private leaderboard split · Publisher methodology checked 2026-09-16