Skip to content

Coding and terminal agents

LiveCodeBench

Competition-style coding, with date-bounded problem releases.

About LiveCodeBench

What it measures

Pass@1 / pass@k on the declared task window.

Scope & limitations

Select problems newer than the evaluated model training cutoff where possible. Harbor has a 100-task port, not the entire evolving dataset.

Evaluation environment

Code generation and isolated test execution.

Source

Original benchmark

Dataset & task catalog ↗