Coding and terminal agents
Android Bench
100 software engineering tasks on Android repositories.
About Android Bench
What it measures
Build/test-based task correctness.
Scope & limitations
This tests building/fixing Android software, not using phone apps. The documented local minimum is 32 GB RAM and 120 GB disk.
Evaluation environment
KVM-capable Linux host, Android tooling and emulators.