Skip to content

Software operations

DevOpsBench-100

Long-horizon DevOps/SRE work over one executable NovaCart world: root-cause analysis, code changes, canaried deploys, migrations, flags, and incident closure.

About DevOpsBench-100

What it measures

Native task success, errors, latency and recorded cost.

Scope & limitations

The published pilot is a subset. Inspect the run protocol before comparing scores.

Evaluation environment

Blobfish-hosted Harbor harness on GKE; frozen task subset.

Source

Original benchmark

Dataset & task catalog ↗