Coding · Benchmark profile
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Data verified 21 Jul 2026 · Methodology 1.6.0
Benchmark score on SWE-bench Multimodal
Claude Mythos 5 leads at 54.9%, followed by Claude Opus 4.8 (38.4%) and Claude Sonnet 5 (28.1%).
Visual analysis
Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.
3 ranked models · higher is better
| Model | Rank | Provider | Score |
|---|---|---|---|
| Claude Mythos 5 | #1 | Anthropic | 54.9% |
| Claude Opus 4.8 | #2 | Anthropic | 38.4% |
| Claude Sonnet 5 | #3 | Anthropic | 28.1% |
One best score per model · higher is better
| Rank | Model | Provider | License | Evidence use | Score |
|---|---|---|---|---|---|
| #1 | Claude Mythos 5 claude-mythos-5 | Anthropic | closed | Reference only | 54.9% |
| #2 | Claude Opus 4.8 claude-opus-4-8 | Anthropic | closed | Reference only | 38.4% |
| #3 | Claude Sonnet 5 claude-sonnet-5 | Anthropic | closed | Estimated reference | 28.1% |
The top of this snapshot is led by Claude Mythos 5 at 54.9%; third place is 26.8 points behind. The top-3 spread is 26.8 points.
About SWE-bench Multimodal
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗FAQ
A multimodal variant of SWE-bench that adds visual context such as screenshots and design mockups to software engineering issue descriptions.
Claude Mythos 5 by Anthropic currently leads with 54.9%.
3 models in the LuminaBench cohort have a qualifying score on this benchmark.
No. This benchmark is display-only and does not enter the overall Lumina composite.
Related
