Coding and terminal agents
HumanEval+ / MBPP+ (EvalPlus)
Small Python function synthesis with expanded tests.
About HumanEval+ / MBPP+ (EvalPlus)
What it measures
Pass@1 / pass@k.
Scope & limitations
Good regression checks, weak standalone evidence for modern autonomous coding; public-data exposure and saturation limit differentiation.