Skip to content

Coding and terminal agents

SWE-Atlas: QnA / Test Writing / Refactoring

Codebase understanding, test authoring and refactoring as separate tracks.

About SWE-Atlas: QnA / Test Writing / Refactoring

What it measures

Track-specific correctness and test-quality measures.

Scope & limitations

Report each track separately. Harbor lists 124 QnA, 90 test-writing and 70 refactoring tasks.

Evaluation environment

Repository agent and separate Atlas harness tracks.

Source

Original benchmark

Dataset & task catalog ↗