About Vals-hosted SWE-bench mirror
Definition and scoring
- Organisation
- Vals AI
- Category
- Knowledge
- Version
- 2026
- Direction
- higher is better
- Ranking use
- Reference
- Contamination risk
- Unknown
Vals AI hosted SWE-bench view for solving production software engineering tasks. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.
Open benchmark source ↗