Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Gemini 3.1 Pro

Google

Strongest in Science (#1 of 122), weakest in Agents (#197 of 298). Above par in 16 of 23 scopes. Among the models it meets almost everywhere, it finishes behind Claude Opus 5.5 and Claude Fable 5.1 and ahead of DeepSeek V4.1 Flash and GPT-5.6 Terra.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Core abilities60.6#11/199
Instruction following69.7#3/62
Language59.6#12/62
Human preference65#16/354
Human preference65#16/354
Knowledge56.4#28/197
Academic knowledge62.2#4/123
Document parsing55.7#32/83
Reasoning56.8#32/195
Science63.5#1/122
Reasoning62.6#12/147
Mathematics51#80/152
Professional53.8#46/194
Medical59.7#10/149
Biology research36.1#29/31
Legal53.8#57/173
Finance54.2#61/162
Coding45.5#122/179
Agentic coding45.3#117/173
Safety49.6#187/329
Factual grounding48.8#61/104
Agents46.2#197/298
Knowledge work43.9#131/208

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Gemini 3.1 Pro, left for the other.

Mistral Medium 3.1won 14 · lost 0
Mistral Large 3won 19 · lost 0
GPT-4.1 nanowon 17 · lost 1
GPT-4o miniwon 16 · lost 1
Llama 4 Scout Instructwon 16 · lost 1
Gemini 2.0 Flashwon 15 · lost 1
Llama 3.3 70B Instructwon 14 · lost 1
Gemini 3.5 Flash-Litewon 18 · lost 2
GPT-4owon 16 · lost 2
Qwen3.6 Pluswon 16 · lost 2
Grok 4 Fastwon 15 · lost 2
Grok 4.1 Fastwon 15 · lost 2
Mistral Medium 3.5won 14 · lost 2
Gemma 4 31Bwon 14 · lost 2
GPT OSS 20Bwon 13 · lost 2
Grok 4.20won 13 · lost 2
Qwen3 Maxwon 12 · lost 2
Claude Opus 4.1won 12 · lost 2
Inklingwon 17 · lost 3
Qwen3.7 Maxwon 17 · lost 3
DeepSeek V3won 16 · lost 3
Gemini 3.1 Flash-Litewon 16 · lost 3
Grok 4.3won 16 · lost 3
Kimi K2.5won 16 · lost 3
DeepSeek R1won 15 · lost 3
Command Awon 14 · lost 3
Grok 3won 14 · lost 3
Claude Opus 4won 14 · lost 3
GPT-5 nanowon 13 · lost 3
MiniMax M2.1won 13 · lost 3
Claude 3.5 Haikuwon 12 · lost 3
Gemini 2.5 Flash-Litewon 12 · lost 3
GPT-5.4 miniwon 16 · lost 4
GPT OSS 120Bwon 15 · lost 4
Kimi K2 Thinkingwon 11 · lost 3
Claude 3.5 Sonnetwon 11 · lost 3
GPT-4.1 miniwon 14 · lost 4
Kimi K2won 14 · lost 4
GLM-4.6won 14 · lost 4
GPT-5.4 nanowon 17 · lost 5
O3 Miniwon 13 · lost 4
MiniMax M2.7won 13 · lost 4
Gemini 3 Flashwon 13 · lost 4
DeepSeek V4 Flashwon 16 · lost 5
Grok 3 Miniwon 12 · lost 4
MiMo V2.5 Prowon 12 · lost 4
Qwen3.8 27Bwon 15 · lost 5
Kimi K2.6won 15 · lost 5
Claude Opus 4.5won 15 · lost 5
GLM-5.2won 15 · lost 5
Claude Haiku 4.5won 14 · lost 5
Qwen3.5 Flashwon 11 · lost 4
O1won 11 · lost 4
MiMo V2.5won 11 · lost 4
O4 Miniwon 13 · lost 5
Gemini 2.5 Flashwon 13 · lost 5
GLM-4.7won 13 · lost 5
MiniMax M2.5won 12 · lost 5
Inkling Smallwon 12 · lost 5
Grok 4won 12 · lost 5
GLM-5won 12 · lost 5
GPT-5 miniwon 14 · lost 6
MiniMax M3won 14 · lost 6
GPT-6 Lunawon 14 · lost 6
Grok 4.5won 14 · lost 6
Claude 3.7 Sonnetwon 11 · lost 5
DeepSeek V3.2won 13 · lost 6
Gemini 3.6 Flashwon 15 · lost 7
Qwen3 235B A22B Instructwon 12 · lost 6
Mistral Large 4won 12 · lost 6
GLM-5.1won 11 · lost 6
Step 5won 9 · lost 5
GPT-5.6 Lunawon 14 · lost 8
Claude Sonnet 4won 12 · lost 7
Claude Haiku 5.5won 12 · lost 7
Claude Sonnet 4.5won 12 · lost 7
GLM-5.3won 12 · lost 7
Claude Sonnet 5won 13 · lost 8
DeepSeek V4 Prowon 13 · lost 8
Gemini 3.5 Flashwon 13 · lost 8
GPT-5.2won 12 · lost 8
Qwen3.8 Maxwon 12 · lost 8
Gemini 2.5 Prowon 11 · lost 8
Claude Sonnet 4.6won 12 · lost 9
GLM-5.3 Flashwon 12 · lost 9
GPT-4.1won 10 · lost 8
Grok 4.7won 10 · lost 8
Gemini 3 Prowon 10 · lost 8
Kimi K3won 11 · lost 9
MiMo V2.6 Flashwon 8 · lost 7
O3won 9 · lost 8
GPT-5won 10 · lost 9
GPT-5.6 Terrawon 11 · lost 10
DeepSeek V4.1 Flashwon 11 · lost 10
Claude Opus 4.6won 10 · lost 10
GPT-5.4won 11 · lost 11
Grok 4.6won 10 · lost 11
GPT-6 Solwon 10 · lost 11
Claude Opus 4.8won 10 · lost 11
Muse Spark 1.1won 9 · lost 10
Muse Spark 1.2won 9 · lost 10
Claude Opus 4.7won 10 · lost 12
GPT-5.1won 8 · lost 10
GPT-5.5won 9 · lost 13
MiMo V2.6 Prowon 6 · lost 9
GPT-5.6 Solwon 9 · lost 14
GPT-6.1 Solwon 6 · lost 13
GPT-6 Astrawon 6 · lost 15
Gemini 3.8 Flashwon 6 · lost 16
Muse Sparkwon 4 · lost 11
Muse Spark 1.3won 4 · lost 11
Claude Sonnet 5.5won 5 · lost 14
Muse Wonderwon 4 · lost 12
Gemini 3.7 Flashwon 5 · lost 15
Claude Opus 5won 4 · lost 17
Claude Fable 5won 3 · lost 17
Gemini 4 Argonwon 2 · lost 15
Claude Fable 5.1won 2 · lost 18
Claude Opus 5.5won 2 · lost 19

§ 3 · Sources

Where the numbers come from

9 publications, 38 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1487
GDPval-AA ↗1 measureread 2026-11-10
GDPval-AA 799
AA-Briefcase ↗1 measureread 2026-11-10
AA-Briefcase 457
ARC-AGI-2 ↗1 measureread 2026-11-10
ARC-AGI-2 77.1%
LiveBench 1.0 ↗8 measuresread 2026-11-10
LiveBench 1.0 77LiveBench 1.0 · Reasoning 84LiveBench 1.0 · Coding 76.5LiveBench 1.0 · Agentic Coding 44.1LiveBench 1.0 · Mathematics 91LiveBench 1.0 · Data Analysis 78.5LiveBench 1.0 · Language 85.4LiveBench 1.0 · Instruction Following 79.1
SimpleBench ↗1 measureread 2026-11-10
SimpleBench 79.6%
Vals.ai ↗18 measuresread 2026-11-10
Vals · Legal Research Bench 20.67%Vals · CaseLaw 64.84%Vals · LegalBench 87.4%Vals · Finance Agent 42.98%Vals · CorpFin 64.49%Vals · TaxEval 72.88%Vals · MortgageTax 69.4%Vals · MedQA 96.37%Vals · MedCode 59.06%Vals · MedScribe 76.11%Vals · BioMysteryBench 60%Vals · SWE-bench Verified 78.8% (Mini-SWE-agent)Vals · Vibe Code Bench 32.03% (OpenHands)Vals · Code Migration 17.31%Vals · GPQA Diamond 95.45%Vals · MMLU Pro 90.99%Vals · AIME 98.13%Vals · ProofBench 26%
ParseBench ↗6 measuresread 2026-11-10
ParseBench · Overall 67.32%ParseBench · Tables 91.13%ParseBench · Charts 40.43%ParseBench · Content faithfulness 89.26%ParseBench · Semantic formatting 44.91%ParseBench · Visual grounding 70.85%
Vectara · Factual consistency 89.6%

Badge

PublicAI Index badge for Gemini 3.1 Pro[![PublicAI Index](https://publicai.io/model-index/badge?model=gemini-3-1-pro)](https://publicai.io/model-index/m/gemini-3-1-pro)