Skip to content

General model capability

Humanity's Last Exam (HLE)

Challenging expert-written multimodal academic questions.

About Humanity's Last Exam (HLE)

What it measures

Answer accuracy and applicable calibration measures.

Scope & limitations

Gated data with redistribution restrictions; tool-enabled and closed-book settings must remain separate.

Evaluation environment

Model with declared text/image/tool access.

Source

Original benchmark

Dataset & task catalog ↗