About Korean Massive Multitask Language Understanding
Definition and scoring
- Organisation
- KMMLU Authors
- Category
- Knowledge
- Version
- 2024
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
Evaluates Korean expert-level knowledge across 45 subjects. 20% of questions require Korean cultural context. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗