About TruthfulQA
Definition and scoring
- Organisation
- Stephanie Lin, Jacob Hilton, Owain Evans
- Category
- Knowledge
- Version
- 2021
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A benchmark designed to measure whether language models produce truthful answers instead of repeating common misconceptions or misleading falsehoods. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗