DevOps and observability
o11y-bench
63 tasks involving observability logs, metrics, traces, dashboards and incidents.
About o11y-bench
What it measures
Task-specific verified outcomes.
Scope & limitations
Publisher-specific environment; qualify integration requirements and avoid treating incident-chat quality as actual remediation.
Evaluation environment
Agent connected to the benchmark observability environment.