Coding and terminal agents
DeepSWE 1.1
113 original long-horizon repository tasks across five programming languages.
About DeepSWE 1.1
What it measures
Behavioral verifier success.
Scope & limitations
Pin 1.1 and verifier runtime; the reference patch is not the grading criterion. Do not confuse this benchmark with similarly named models.