About Pencil Puzzle Bench
Definition and scoring
- Organisation
- Approximate Labs
- Category
- Reasoning
- Version
- 2026
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
A multi-step verifiable reasoning benchmark that evaluates whether models can solve pencil puzzles with unique solutions. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗