Skip to content

General model capability

GPQA Diamond

Expert-level science multiple-choice questions; Diamond has 198 questions.

About GPQA Diamond

What it measures

Answer accuracy.

Scope & limitations

Gated original data; high science reasoning accuracy does not establish agent reliability.

Evaluation environment

Text model with explicitly declared tools.

Source

Original benchmark

Dataset & task catalog ↗