Skip to content

General model capability

MMLU-Pro

Broad knowledge/reasoning across academic domains.

About MMLU-Pro

What it measures

Multiple-choice accuracy by domain.

Scope & limitations

Supporting model diagnostic; low differentiation as the only benchmark offered to application companies.

Evaluation environment

Text model with fixed prompt/answer extraction.

Source

Original benchmark

Dataset & task catalog ↗