VulcanBench v3 leaderboard
3 ranked models · higher is better
View accessible chart data
| Model | Rank | Provider | Score |
|---|---|---|---|
| Grok 4.5 | #1 | xAI | 91.3% |
| Claude Fable 5 | #2 | Anthropic | 87% |
| GPT-5.6 Sol | #3 | OpenAI | 87% |
Loading benchmark header
Loading benchmark registry
Coding · Benchmark profile
An open software-engineering benchmark built from real merged post-cutoff pull requests across Python, Rust, TypeScript, JavaScript, and Go repositories.
Data verified 21 Jul 2026 · Methodology 1.6.0
Benchmark score on VulcanBench v3
Grok 4.5 leads at 91.3%, followed by Claude Fable 5 (87%) and GPT-5.6 Sol (87%).
Visual analysis
Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.
3 ranked models · higher is better
| Model | Rank | Provider | Score |
|---|---|---|---|
| Grok 4.5 | #1 | xAI | 91.3% |
| Claude Fable 5 | #2 | Anthropic | 87% |
| GPT-5.6 Sol | #3 | OpenAI | 87% |
One best score per model · higher is better
| Rank | Model | Provider | License | Evidence use | Score |
|---|---|---|---|---|---|
| #1 | Grok 4.5 grok-4.5 | xAI | closed | Reference only | 91.3% |
| #2 | Claude Fable 5 claude-fable-5 | Anthropic | closed | Reference only | 87% |
| #3 | GPT-5.6 Sol gpt-5.6-sol | OpenAI | closed | Reference only | 87% |
The top of this snapshot is led by Grok 4.5 at 91.3%; third place is 4.3 points behind. The top-3 spread is 4.3 points.
About VulcanBench v3
An open software-engineering benchmark built from real merged post-cutoff pull requests across Python, Rust, TypeScript, JavaScript, and Go repositories. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗FAQ
An open software-engineering benchmark built from real merged post-cutoff pull requests across Python, Rust, TypeScript, JavaScript, and Go repositories.
Grok 4.5 by xAI currently leads with 91.3%.
3 models in the LuminaBench cohort have a qualifying score on this benchmark.
No. This benchmark is display-only and does not enter the overall Lumina composite.
Related