Search and deep research
SimpleQA
Short fact-seeking questions with reference answers.
About SimpleQA
What it measures
Correctness, abstention and attempted-answer accuracy.
Scope & limitations
Keep browse-enabled and closed-book results separate; narrower and often less discriminating than BrowseComp.
Evaluation environment
Question-answering endpoint; explicitly declare browsing.