Skip to content

Coding and terminal agents

Aider Polyglot

225 programming exercises across six languages.

About Aider Polyglot

What it measures

Exercise pass rate and editing-format success.

Scope & limitations

Useful for editing and language coverage; does not replace repository-scale SWE evaluation. Keep retry policy fixed.

Evaluation environment

Aider-style edit/apply/test interaction.

Source

Original benchmark

Dataset & task catalog ↗