Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Gemini 4 Carbon

Google

Strongest in Human preference (#1 of 354), weakest in Professional (#28 of 194). Above par in 12 of 12 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5.2 and Muse Wonder Full and ahead of Muse Wonder and GPT-6.1 Sol.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Human preference68.8#1/354
Human preference68.8#1/354
Core abilities61.9#6/199
General intelligence67.1#7/178
Reasoning62.7#8/195
Reasoning68.4#2/147
Agents60.7#10/298
Knowledge work67.1#10/208
Coding56.3#27/179
Agentic coding56.9#25/173
Professional55.6#28/194
Legal61.3#8/173

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Gemini 4 Carbon, left for the other.

Qwen3.6 27Bwon 8 · lost 0
Smaug Nemotron 3.5won 8 · lost 0
Kimi K2 Thinkingwon 8 · lost 0
Llama 3.3 70B Instructwon 8 · lost 0
Qwen3 32Bwon 8 · lost 0
Gemma 3 27B ITwon 8 · lost 0
Gemini 2.5 Flash-Litewon 8 · lost 0
MiniMax M2.1won 8 · lost 0
O1won 8 · lost 0
DeepSeek V3.1won 8 · lost 0
Qwen3.7 Pluswon 8 · lost 0
Qwen3.6 Maxwon 8 · lost 0
Gemini 3 Flashwon 8 · lost 0
GPT OSS 20Bwon 9 · lost 0
Claude 3.5 Haikuwon 9 · lost 0
GPT-5 nanowon 9 · lost 0
Claude 3.7 Sonnetwon 9 · lost 0
MiniMax M2.7won 9 · lost 0
Qwen3 Maxwon 9 · lost 0
Grok 4.1 Fastwon 9 · lost 0
MiMo V2.5won 9 · lost 0
MiMo V2.5 Prowon 9 · lost 0
Nemotron 3.5 Super VLwon 10 · lost 0
Muse Spark Openwon 10 · lost 0
Beam 1.0won 10 · lost 0
MiniMax M3.1 Flashwon 10 · lost 0
Llama 4 Scout Instructwon 10 · lost 0
GPT-4owon 10 · lost 0
Command Awon 10 · lost 0
Gemini 2.0 Flashwon 10 · lost 0
O3 Miniwon 10 · lost 0
Grok 3 Miniwon 10 · lost 0
MiniMax M2.5won 10 · lost 0
Grok 4 Fastwon 10 · lost 0
Grok 3won 10 · lost 0
Claude Haiku 4.5won 10 · lost 0
Claude Opus 4won 10 · lost 0
GLM-4.7won 10 · lost 0
Grok 4.3won 10 · lost 0
Qwen3.6 Pluswon 10 · lost 0
GLM-5won 10 · lost 0
Kimi K2.6won 10 · lost 0
GLM-5.1won 10 · lost 0
Grok 4.20won 10 · lost 0
GPT-4o miniwon 11 · lost 0
Gemini 2.5 Flashwon 11 · lost 0
Grok 4won 11 · lost 0
Kimi K2won 11 · lost 0
Qwen3 235B A22B Instructwon 11 · lost 0
GLM-4.6won 11 · lost 0
Mistral Medium 3.5won 11 · lost 0
Gemini 3.1 Flash-Litewon 11 · lost 0
MiMo V2.6 Flashwon 11 · lost 0
Claude Sonnet 5won 11 · lost 0
Qwen3.7 Maxwon 11 · lost 0
Gemini 3.6 Flashwon 11 · lost 0
Gemini 3 Prowon 11 · lost 0
Gemini 3.1 Prowon 11 · lost 0
Gemini 3.7 Flashwon 11 · lost 0
GPT-4.1 nanowon 12 · lost 0
GPT OSS 120Bwon 12 · lost 0
GPT-4.1 miniwon 12 · lost 0
GPT-5 miniwon 12 · lost 0
DeepSeek V3won 12 · lost 0
GPT-5.4 nanowon 12 · lost 0
Claude Sonnet 4won 12 · lost 0
Inkling Smallwon 12 · lost 0
Inkling 2 Smallwon 12 · lost 0
Mistral Large 3won 12 · lost 0
Claude Haiku 5.5won 12 · lost 0
Mistral Large 4won 12 · lost 0
DeepSeek V3.2won 12 · lost 0
Qwen3.8 27Bwon 12 · lost 0
MiniMax M3won 12 · lost 0
DeepSeek V4 Flashwon 12 · lost 0
GPT-6 Lunawon 12 · lost 0
Inklingwon 12 · lost 0
Gemini 2.5 Prowon 12 · lost 0
GPT-5.4 miniwon 12 · lost 0
Step 5won 12 · lost 0
Kimi K2.5won 12 · lost 0
Gemma 4 31Bwon 12 · lost 0
GPT-5.6 Lunawon 12 · lost 0
Gemini 3.5 Flash-Litewon 12 · lost 0
Claude Sonnet 4.5won 12 · lost 0
Grok 4.5won 12 · lost 0
GLM-5.3 Flashwon 12 · lost 0
GLM-5.2won 12 · lost 0
GPT-5.4won 12 · lost 0
MiMo V2.6 Prowon 12 · lost 0
Qwen3.8 Maxwon 12 · lost 0
Gemini 3.8 Flashwon 12 · lost 0
DeepSeek R1won 11 · lost 1
GPT-5won 11 · lost 1
Grok 4.7won 11 · lost 1
Kimi K3.1 Prowon 11 · lost 1
Kimi K3won 11 · lost 1
Claude Opus 4.7won 11 · lost 1
O4 Miniwon 10 · lost 1
GPT-4.1won 10 · lost 1
GPT-5.2won 10 · lost 1
Claude Sonnet 4.6won 10 · lost 1
Claude Opus 4.5won 10 · lost 1
Gemini 3.5 Flashwon 10 · lost 1
Muse Spark 1.2won 10 · lost 1
Muse Spark 1.1won 9 · lost 1
Claude Opus 4.6won 9 · lost 1
Muse Sparkwon 8 · lost 1
DeepSeek V4 Prowon 10 · lost 2
GPT-5.6 Terrawon 10 · lost 2
DeepSeek V4.1 Flashwon 10 · lost 2
GPT-5.5won 10 · lost 2
Claude Opus 4.8won 10 · lost 2
GLM-5.3won 10 · lost 2
Muse Spark 1.3won 10 · lost 2
O3won 9 · lost 2
GPT-6 Solwon 9 · lost 2
Muse Emberwon 8 · lost 2
GPT-6.1 Terrawon 8 · lost 2
GPT-5.1won 8 · lost 2
Grok 4.6won 9 · lost 3
GPT-5.6 Solwon 9 · lost 3
Claude Sonnet 5.5won 7 · lost 5
GPT-6.1 Solwon 7 · lost 5
Muse Wonderwon 7 · lost 5
GPT-6 Astrawon 6 · lost 6
Claude Fable 5won 6 · lost 6
Claude Fable 5.1won 5 · lost 7
Claude Opus 5.5won 5 · lost 7
Gemini 4 Argonwon 5 · lost 7
Claude Opus 5won 4 · lost 7
Muse Wonder Fullwon 3 · lost 6
Claude Fable 5.2won 2 · lost 8

§ 3 · Sources

Where the numbers come from

7 publications, 9 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1526
Artificial Analysis ↗1 measureread 2026-11-10
Artificial Analysis Intelligence Index 60
GDPval-AA ↗1 measureread 2026-11-10
GDPval-AA 1733
AA-Briefcase ↗1 measureread 2026-11-10
AA-Briefcase 1611
ARC-AGI-2 ↗1 measureread 2026-11-10
ARC-AGI-2 92.1%
SimpleBench ↗1 measureread 2026-11-10
SimpleBench 92.6%
Vals.ai ↗3 measuresread 2026-11-10
Vals · Legal Research Bench 55.77%Vals · Harvey Legal Agent Benchmark 17.5%Vals · Vibe Code Bench 89.06% (OpenHands)

Badge

PublicAI Index badge for Gemini 4 Carbon[![PublicAI Index](https://publicai.io/model-index/badge?model=gemini-4-carbon)](https://publicai.io/model-index/m/gemini-4-carbon)