About SimpleQA Verified
Definition and scoring
- Organisation
- OpenAI / Google
- Category
- Research
- Version
- verified
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Medium
Factual short-answer evaluation derived from SimpleQA with stricter verification protocols against known ground-truth answers. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗