Software operations / Benchmark leaderboard
DevOpsBench-100
Long-horizon DevOps/SRE work over one executable NovaCart world: root-cause analysis, code changes, canaried deploys, migrations, flags, and incident closure.
No published company result yet.
A frozen task package is registered in the hosted GKE harness. Reviewed agent results will appear here when publication is complete.
View existing benchmark evidence and release status →
Arrange an evaluation for your company →What this benchmark measures
Metrics
Native task success, errors, latency and recorded cost.
Execution requirements
Blobfish-hosted Harbor harness on GKE; frozen task subset.
Scope and limitations
The published pilot is a subset. Inspect the run protocol before comparing scores.
Evaluation availability
A managed Harbor task package is registered on GKE. Published reports identify the agent configurations and selected tasks.
Read the harness and grading protocol →Sources and company fit
- Original benchmark ↗Hosted task package
- Harbor · blobfishai/devopsbench-100 ↗100 source tasks · Public · Public description screening