Skip to content

General model capability

GSM8K

Grade-school multi-step arithmetic word problems.

About GSM8K

What it measures

Exact-answer accuracy.

Scope & limitations

Famous but widely exposed and often saturated; keep for regression, not the central value proposition of a new evaluation service.

Evaluation environment

Text model with specified calculator/code access.

Source

Original benchmark

Dataset & task catalog ↗