DevOps and observability
ITSMBench
53 multi-turn IT service tasks with policies and stateful business records.
About ITSMBench
What it measures
Binary final database-state correctness.
Scope & limitations
Requires benchmark tool semantics and identity/policy fidelity; useful niche fit rather than established broad fame.
Evaluation environment
Benchmark tenant, tool adapter and simulated colleague.