Coding · Benchmark profile
Cognition's 100-task software-engineering benchmark for whether coding agents produce mergeable, production-quality pull requests, scored for correctness, tests, scope, style, and maintainability through maintainer-authored rubrics.
Data verified 21 Jul 2026 · Methodology 1.6.0
Benchmark score on FrontierCode 1.1 Main
Claude Fable 5 leads at 53.5%, followed by Claude Opus 4.8 (46.5%) and GPT-5.5 (43%).
Visual analysis
Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.
9 ranked models · higher is better
| Model | Rank | Provider | Score |
|---|---|---|---|
| Claude Fable 5 | #1 | Anthropic | 53.5% |
| Claude Opus 4.8 | #2 | Anthropic | 46.5% |
| GPT-5.5 | #3 | OpenAI | 43% |
| Claude Sonnet 5 | #4 | Anthropic | 42.7% |
| SWE-1.7 | #5 | Cognition | 42.3% |
| Claude Opus 4.7 | #6 | Anthropic | 38.5% |
| GPT-5.4 mini | #7 | OpenAI | 27% |
| Claude Opus 4.6 | #8 | Anthropic | 26.9% |
| Claude Sonnet 4.6 | #9 | Anthropic | 24.3% |
One best score per model · higher is better
| Rank | Model | Provider | License | Evidence use | Score |
|---|---|---|---|---|---|
| #1 | Claude Fable 5 claude-fable-5 | Anthropic | closed | Reference only | 53.5% |
| #2 | Claude Opus 4.8 claude-opus-4-8 | Anthropic | closed | Reference only | 46.5% |
| #3 | GPT-5.5 gpt-5.5 | OpenAI | closed | Estimated reference | 43% |
| #4 | Claude Sonnet 5 claude-sonnet-5 | Anthropic | closed | Estimated reference | 42.7% |
| #5 | SWE-1.7 swe-1-7 | Cognition | closed | Estimated reference | 42.3% |
| #6 | Claude Opus 4.7 claude-opus-4-7 | Anthropic | closed | Reference only | 38.5% |
| #7 | GPT-5.4 mini gpt-5.4-mini | OpenAI | closed | Estimated reference | 27% |
| #8 | Claude Opus 4.6 claude-opus-4-6 | Anthropic | closed | Reference only | 26.9% |
| #9 | Claude Sonnet 4.6 claude-sonnet-4-6 | Anthropic | closed | Reference only | 24.3% |
The top of this snapshot is led by Claude Fable 5 at 53.5%; third place is 10.5 points behind. The top-9 spread is 29.2 points.
About FrontierCode 1.1 Main
Cognition's 100-task software-engineering benchmark for whether coding agents produce mergeable, production-quality pull requests, scored for correctness, tests, scope, style, and maintainability through maintainer-authored rubrics. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗FAQ
Cognition's 100-task software-engineering benchmark for whether coding agents produce mergeable, production-quality pull requests, scored for correctness, tests, scope, style, and maintainability through maintainer-authored rubrics.
Claude Fable 5 by Anthropic currently leads with 53.5%.
9 models in the LuminaBench cohort have a qualifying score on this benchmark.
No. This benchmark is display-only and does not enter the overall Lumina composite.
Related
