Coding · Benchmark profile

Vibe Code Bench v1.1

Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.

Reference2026Active41 models

Data verified 21 Jul 2026 · Methodology 1.6.0

Benchmark score on Vibe Code Bench v1.1

Leaderboard · 41 models

Claude Opus 4.7 leads at 71.0%, followed by GPT-5.5 (69.8%) and GPT-5.4 (67.4%).

Display onlyCoding2026

#1Closed

Claude Opus 4.7

Anthropic

claude-opus-4-7

71.0%

Overall #12 · Context 1M tokens

#2Closed

GPT-5.5

OpenAI

gpt-5.5

69.8%

Overall #8 · Context 1.05M tokens

#3Closed

GPT-5.4

OpenAI

gpt-5.4

67.4%

Overall #9 · Context 1.05M tokens

Visual analysis

See the field.

Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.

ViewModelsColours

AnthropicOpenAIDeepSeekGoogleMoonshot AIZ.AIMiniMaxAlibaba Cloud

Vibe Code Bench v1.1 leaderboard

20 ranked models · higher is better

View accessible chart data

Accessible data for Vibe Code Bench v1.1 leaderboard
Model	Rank	Provider	Score
Claude Opus 4.7	#1	Anthropic	71.0%
GPT-5.5	#2	OpenAI	69.8%
GPT-5.4	#3	OpenAI	67.4%
GPT-5.3-Codex	#4	OpenAI	61.8%
Claude Opus 4.6	#5	Anthropic	57.6%
GPT-5.2	#6	OpenAI	53.5%
Claude Opus 4.6 (Adaptive)	#7	Anthropic	53.5%
Claude Sonnet 4.6	#8	Anthropic	51.5%
DeepSeek V4 Pro (Max)	#9	DeepSeek	49.9%
Gemini 3.5 Flash	#10	Google	48.7%
GPT-5.4 mini	#11	OpenAI	48.0%
GPT-5.2 Codex	#12	OpenAI	37.9%
Kimi K2.6	#13	Moonshot AI	37.9%
Gemini 3.1 Pro	#14	Google	32.0%
GLM-5.1	#15	Z.AI	31.5%
MiniMax M2.7	#16	MiniMax	27.0%
GPT-5.4 nano	#17	OpenAI	26.1%
Qwen3.6 Plus	#18	Alibaba Cloud	25.6%
GPT-5.1	#19	OpenAI	24.6%
GLM-5 (Reasoning)	#20	Z.AI	23.4%

Benchmark score table (41 models)

One best score per model · higher is better

Vibe Code Bench v1.1 leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Claude Opus 4.7 claude-opus-4-7	Anthropic	closed	Reference only	71.0%
#2	GPT-5.5 gpt-5.5	OpenAI	closed	Estimated reference	69.8%
#3	GPT-5.4 gpt-5.4	OpenAI	closed	Reference only	67.4%
#4	GPT-5.3-Codex gpt-5.3-codex	OpenAI	closed	Reference only	61.8%
#5	Claude Opus 4.6 claude-opus-4-6	Anthropic	closed	Reference only	57.6%
#6	GPT-5.2 gpt-5.2	OpenAI	closed	Estimated reference	53.5%
#7	Claude Opus 4.6 (Adaptive) claude-opus-4-6-thinking	Anthropic	closed	Estimated reference	53.5%
#8	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Reference only	51.5%
#9	DeepSeek V4 Pro (Max) deepseek-v4-pro-max	DeepSeek	open	Estimated reference	49.9%
#10	Gemini 3.5 Flash gemini-3.5-flash	Google	closed	Estimated reference	48.7%
#11	GPT-5.4 mini gpt-5.4-mini	OpenAI	closed	Estimated reference	48.0%
#12	GPT-5.2 Codex gpt-5.2-codex	OpenAI	closed	Reference only	37.9%
#13	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Estimated reference	37.9%
#14	Gemini 3.1 Pro gemini-3-1-pro	Google	closed	Estimated reference	32.0%
#15	GLM-5.1 glm-5-1	Z.AI	open	Reference only	31.5%
#16	MiniMax M2.7 minimax-m2-7	MiniMax	open	Reference only	27.0%
#17	GPT-5.4 nano gpt.5.4.nano	OpenAI	closed	Reference only	26.1%
#18	Qwen3.6 Plus qwen3-6-plus	Alibaba Cloud	closed	Reference only	25.6%
#19	GPT-5.1 gpt.5.1	OpenAI	closed	Estimated reference	24.6%
#20	GLM-5 (Reasoning) glm-5-reasoning	Z.AI	open	Estimated reference	23.4%
#21	Claude Sonnet 4.5 Thinking claude-sonnet-4-5-thinking	Anthropic	closed	Estimated reference	22.6%
#22	GPT-5.1-Codex-Max gpt-5-1-codex-max	OpenAI	closed	Estimated reference	22.2%
#23	Claude Opus 4.5 Thinking claude-opus-4-5-thinking	Anthropic	closed	Estimated reference	20.6%
#24	Gemini 3 Flash gemini-3-flash	Google	closed	Reference only	20.2%
#25	GPT-5 (high) gpt-5-high	OpenAI	closed	Estimated reference	20.1%
#26	Muse Spark muse-spark	Meta	closed	Reference only	19.7%
#27	Kimi K2.5 (Reasoning) kimi-k2-5-reasoning	Moonshot AI	closed	Estimated reference	17.5%
#28	Qwen3.5 Plus qwen3-5-plus	Alibaba Cloud	closed	Estimated reference	15.7%
#29	MiniMax M2.5 minimax-m2.5	MiniMax	open	Reference only	14.9%
#30	Gemini 3 Pro gemini-3-pro	Google	closed	Reference only	14.3%
#31	GPT-5 mini gpt-5-mini	OpenAI	closed	Reference only	14.2%
#32	GPT-5.1-Codex gpt-5-1-codex	OpenAI	closed	Estimated reference	13.1%
#33	Claude Haiku 4.5 Thinking claude-haiku-4-5-thinking	Anthropic	closed	Estimated reference	11.4%
#34	DeepSeek V3.2 (Thinking) deepseek-v3-2-thinking	DeepSeek	open	Estimated reference	5.1%
#35	Grok 4.20 grok-4.20	xAI	closed	Estimated reference	4.1%
#36	Qwen3 Max qwen3-max	Alibaba Cloud	closed	Estimated reference	3.5%
#37	GLM-4.6 glm-4.6	Z.AI	open	Reference only	3.1%
#38	Grok 4.1 Fast (Reasoning) grok-4-1-fast-reasoning	xAI	closed	Reference only	1.2%
#39	Gemini 2.5 Pro gemini-2.5-pro	Google	closed	Reference only	0.4%
#40	Gemini 3.1 Flash-Lite gemini-3.1-flash-lite	Google	closed	Reference only	0%
#41	Grok 4 Fast (Reasoning) grok-4-fast-reasoning	xAI	closed	Reference only	0%

The top of this snapshot is led by Claude Opus 4.7 at 71.0%; third place is 3.6 points behind. The top-10 spread is 22.3 points.

Compare top models

Claude Opus 4.7 vs GPT-5.5 GPT-5.5 vs GPT-5.4 GPT-5.4 vs GPT-5.3-Codex GPT-5.3-Codex vs Claude Opus 4.6

About Vibe Code Bench v1.1

Definition and scoring

Organisation: Vals AI
Category: Coding
Version: 2026
Direction: higher is better
Ranking use: Reference
Contamination risk: Unknown

Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment. Results stay tied to the exact model variant and evaluation system. Multiple systems for the same model use the best published score on this page; overall Lumina scoring uses the median of ranking-eligible rows.

Open benchmark source ↗

FAQ

Quick answers

What does Vibe Code Bench v1.1 measure?

Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.

Which model scores highest on Vibe Code Bench v1.1?

Claude Opus 4.7 by Anthropic currently leads with 71.0%.

How many models are evaluated on Vibe Code Bench v1.1?

41 models in the LuminaBench cohort have a qualifying score on this benchmark.

Does this affect overall Lumina rank?

No. This benchmark is display-only and does not enter the overall Lumina composite.

LiveCodeBench

Rolling · 44 results · Weighted 3.2%

SWE-bench Verified

Verified · 79 results · Weighted 3.2%

CRUXEval

Rolling · Not evaluated · Not Weighted

SciCode

Rolling · 238 results · Weighted 3.2%

BigCodeBench

Rolling · 2 results · Not Weighted

SWE-Bench Pro

v1 · 92 results · Weighted 3.2%

Coding · Benchmark profile

Vibe Code Bench v1.1

Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.

Reference2026Active41 models

Data verified 21 Jul 2026 · Methodology 1.6.0

Benchmark score on Vibe Code Bench v1.1

Leaderboard · 41 models

Claude Opus 4.7 leads at 71.0%, followed by GPT-5.5 (69.8%) and GPT-5.4 (67.4%).

Display onlyCoding2026

#1Closed

Claude Opus 4.7

Anthropic

claude-opus-4-7

71.0%

Overall #12 · Context 1M tokens

#2Closed

GPT-5.5

OpenAI

gpt-5.5

69.8%

Overall #8 · Context 1.05M tokens

#3Closed

GPT-5.4

OpenAI

gpt-5.4

67.4%

Overall #9 · Context 1.05M tokens

Visual analysis

See the field.

Switch between model placement, score distribution and descriptive provider averages. Every view uses the same sourced leaderboard.

ViewModelsColours

AnthropicOpenAIDeepSeekGoogleMoonshot AIZ.AIMiniMaxAlibaba Cloud

Vibe Code Bench v1.1 leaderboard

20 ranked models · higher is better

View accessible chart data

Accessible data for Vibe Code Bench v1.1 leaderboard
Model	Rank	Provider	Score
Claude Opus 4.7	#1	Anthropic	71.0%
GPT-5.5	#2	OpenAI	69.8%
GPT-5.4	#3	OpenAI	67.4%
GPT-5.3-Codex	#4	OpenAI	61.8%
Claude Opus 4.6	#5	Anthropic	57.6%
GPT-5.2	#6	OpenAI	53.5%
Claude Opus 4.6 (Adaptive)	#7	Anthropic	53.5%
Claude Sonnet 4.6	#8	Anthropic	51.5%
DeepSeek V4 Pro (Max)	#9	DeepSeek	49.9%
Gemini 3.5 Flash	#10	Google	48.7%
GPT-5.4 mini	#11	OpenAI	48.0%
GPT-5.2 Codex	#12	OpenAI	37.9%
Kimi K2.6	#13	Moonshot AI	37.9%
Gemini 3.1 Pro	#14	Google	32.0%
GLM-5.1	#15	Z.AI	31.5%
MiniMax M2.7	#16	MiniMax	27.0%
GPT-5.4 nano	#17	OpenAI	26.1%
Qwen3.6 Plus	#18	Alibaba Cloud	25.6%
GPT-5.1	#19	OpenAI	24.6%
GLM-5 (Reasoning)	#20	Z.AI	23.4%

Benchmark score table (41 models)

One best score per model · higher is better

Vibe Code Bench v1.1 leaderboard ranked by score
Rank	Model	Provider	License	Evidence use	Score
#1	Claude Opus 4.7 claude-opus-4-7	Anthropic	closed	Reference only	71.0%
#2	GPT-5.5 gpt-5.5	OpenAI	closed	Estimated reference	69.8%
#3	GPT-5.4 gpt-5.4	OpenAI	closed	Reference only	67.4%
#4	GPT-5.3-Codex gpt-5.3-codex	OpenAI	closed	Reference only	61.8%
#5	Claude Opus 4.6 claude-opus-4-6	Anthropic	closed	Reference only	57.6%
#6	GPT-5.2 gpt-5.2	OpenAI	closed	Estimated reference	53.5%
#7	Claude Opus 4.6 (Adaptive) claude-opus-4-6-thinking	Anthropic	closed	Estimated reference	53.5%
#8	Claude Sonnet 4.6 claude-sonnet-4-6	Anthropic	closed	Reference only	51.5%
#9	DeepSeek V4 Pro (Max) deepseek-v4-pro-max	DeepSeek	open	Estimated reference	49.9%
#10	Gemini 3.5 Flash gemini-3.5-flash	Google	closed	Estimated reference	48.7%
#11	GPT-5.4 mini gpt-5.4-mini	OpenAI	closed	Estimated reference	48.0%
#12	GPT-5.2 Codex gpt-5.2-codex	OpenAI	closed	Reference only	37.9%
#13	Kimi K2.6 kimi-k2.6	Moonshot AI	open	Estimated reference	37.9%
#14	Gemini 3.1 Pro gemini-3-1-pro	Google	closed	Estimated reference	32.0%
#15	GLM-5.1 glm-5-1	Z.AI	open	Reference only	31.5%
#16	MiniMax M2.7 minimax-m2-7	MiniMax	open	Reference only	27.0%
#17	GPT-5.4 nano gpt.5.4.nano	OpenAI	closed	Reference only	26.1%
#18	Qwen3.6 Plus qwen3-6-plus	Alibaba Cloud	closed	Reference only	25.6%
#19	GPT-5.1 gpt.5.1	OpenAI	closed	Estimated reference	24.6%
#20	GLM-5 (Reasoning) glm-5-reasoning	Z.AI	open	Estimated reference	23.4%
#21	Claude Sonnet 4.5 Thinking claude-sonnet-4-5-thinking	Anthropic	closed	Estimated reference	22.6%
#22	GPT-5.1-Codex-Max gpt-5-1-codex-max	OpenAI	closed	Estimated reference	22.2%
#23	Claude Opus 4.5 Thinking claude-opus-4-5-thinking	Anthropic	closed	Estimated reference	20.6%
#24	Gemini 3 Flash gemini-3-flash	Google	closed	Reference only	20.2%
#25	GPT-5 (high) gpt-5-high	OpenAI	closed	Estimated reference	20.1%
#26	Muse Spark muse-spark	Meta	closed	Reference only	19.7%
#27	Kimi K2.5 (Reasoning) kimi-k2-5-reasoning	Moonshot AI	closed	Estimated reference	17.5%
#28	Qwen3.5 Plus qwen3-5-plus	Alibaba Cloud	closed	Estimated reference	15.7%
#29	MiniMax M2.5 minimax-m2.5	MiniMax	open	Reference only	14.9%
#30	Gemini 3 Pro gemini-3-pro	Google	closed	Reference only	14.3%
#31	GPT-5 mini gpt-5-mini	OpenAI	closed	Reference only	14.2%
#32	GPT-5.1-Codex gpt-5-1-codex	OpenAI	closed	Estimated reference	13.1%
#33	Claude Haiku 4.5 Thinking claude-haiku-4-5-thinking	Anthropic	closed	Estimated reference	11.4%
#34	DeepSeek V3.2 (Thinking) deepseek-v3-2-thinking	DeepSeek	open	Estimated reference	5.1%
#35	Grok 4.20 grok-4.20	xAI	closed	Estimated reference	4.1%
#36	Qwen3 Max qwen3-max	Alibaba Cloud	closed	Estimated reference	3.5%
#37	GLM-4.6 glm-4.6	Z.AI	open	Reference only	3.1%
#38	Grok 4.1 Fast (Reasoning) grok-4-1-fast-reasoning	xAI	closed	Reference only	1.2%
#39	Gemini 2.5 Pro gemini-2.5-pro	Google	closed	Reference only	0.4%
#40	Gemini 3.1 Flash-Lite gemini-3.1-flash-lite	Google	closed	Reference only	0%
#41	Grok 4 Fast (Reasoning) grok-4-fast-reasoning	xAI	closed	Reference only	0%

The top of this snapshot is led by Claude Opus 4.7 at 71.0%; third place is 3.6 points behind. The top-10 spread is 22.3 points.

Compare top models

Claude Opus 4.7 vs GPT-5.5 GPT-5.5 vs GPT-5.4 GPT-5.4 vs GPT-5.3-Codex GPT-5.3-Codex vs Claude Opus 4.6

About Vibe Code Bench v1.1

Definition and scoring

Organisation: Vals AI
Category: Coding
Version: 2026
Direction: higher is better
Ranking use: Reference
Contamination risk: Unknown

Open benchmark source ↗

FAQ

Quick answers

What does Vibe Code Bench v1.1 measure?

Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.

Which model scores highest on Vibe Code Bench v1.1?

Claude Opus 4.7 by Anthropic currently leads with 71.0%.

How many models are evaluated on Vibe Code Bench v1.1?

41 models in the LuminaBench cohort have a qualifying score on this benchmark.

Does this affect overall Lumina rank?

No. This benchmark is display-only and does not enter the overall Lumina composite.

LiveCodeBench

Rolling · 44 results · Weighted 3.2%

SWE-bench Verified

Verified · 79 results · Weighted 3.2%

CRUXEval

Rolling · Not evaluated · Not Weighted

SciCode

Rolling · 238 results · Weighted 3.2%

BigCodeBench

Rolling · 2 results · Not Weighted

SWE-Bench Pro

v1 · 92 results · Weighted 3.2%

Search LUMINA BENCH

Navigation

Vibe Code Bench v1.1

Leaderboard · 41 models

Claude Opus 4.7

GPT-5.5

GPT-5.4

See the field.

Vibe Code Bench v1.1 leaderboard

Crop Vibe Code Bench v1.1 leaderboard

Benchmark score table (41 models)

Crop Vibe Code Bench v1.1 benchmark table

Compare top models

Definition and scoring

Quick answers

What does Vibe Code Bench v1.1 measure?

Which model scores highest on Vibe Code Bench v1.1?

How many models are evaluated on Vibe Code Bench v1.1?

Does this affect overall Lumina rank?

Vibe Code Bench v1.1

Leaderboard · 41 models

Claude Opus 4.7

GPT-5.5

GPT-5.4

See the field.

Vibe Code Bench v1.1 leaderboard

Crop Vibe Code Bench v1.1 leaderboard

Benchmark score table (41 models)

Crop Vibe Code Bench v1.1 benchmark table

Compare top models

Definition and scoring

Quick answers

What does Vibe Code Bench v1.1 measure?

Which model scores highest on Vibe Code Bench v1.1?

How many models are evaluated on Vibe Code Bench v1.1?

Does this affect overall Lumina rank?

Leaderboard · 41 models

Claude Opus 4.7

GPT-5.5

GPT-5.4

See the field.

Benchmark score table (41 models)

Compare top models

Definition and scoring

Quick answers

What does Vibe Code Bench v1.1 measure?

Which model scores highest on Vibe Code Bench v1.1?

How many models are evaluated on Vibe Code Bench v1.1?

Does this affect overall Lumina rank?

More Coding benchmarks

Leaderboard · 41 models

Claude Opus 4.7

GPT-5.5

GPT-5.4

See the field.

Benchmark score table (41 models)

Compare top models

Definition and scoring

Quick answers

What does Vibe Code Bench v1.1 measure?

Which model scores highest on Vibe Code Bench v1.1?

How many models are evaluated on Vibe Code Bench v1.1?

Does this affect overall Lumina rank?

More Coding benchmarks