DevOps and observability / Benchmark leaderboard
o11y-bench
63 tasks involving observability logs, metrics, traces, dashboards and incidents.
No published company result yet.
This benchmark is in the research directory. Its task package, adapter and grading protocol need qualification before a hosted run can be offered.
Arrange an evaluation for your company →What this benchmark measures
Metrics
Task-specific verified outcomes.
Execution requirements
Agent connected to the benchmark observability environment.
Scope and limitations
Publisher-specific environment; qualify integration requirements and avoid treating incident-chat quality as actual remediation.
Evaluation availability
Catalog entry. Request a managed evaluation to qualify your agent interface and the benchmark’s native grading requirements.
Sources and company fit
- Original benchmark ↗Newer specialist
- Harbor · grafana/o11y-bench ↗63 source tasks · Public · Public detail metadata + family research
Companies whose products may fit
Research recommendations based on product capabilities. These companies have not necessarily run this benchmark or integrated with Blobfish.
Compatibility notes for each company
Datadog: Capability-aligned; adapter/access to qualify
Grafana: Capability-aligned; adapter/access to qualify
PagerDuty: Capability-aligned; adapter/access to qualify
Resolve AI: Capability-aligned; adapter/access to qualify
Sentry: Capability-aligned; adapter/access to qualify
ServiceNow: Product-specific adapter / qualified access