Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Gemini 3.5 Flash

Google

Strongest in Instruction following (#7 of 62), weakest in Harm refusal (#257 of 292). Above par in 18 of 27 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5.1 and Claude Opus 5.5 and ahead of GPT-5.6 Terra and Mistral Large 4.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Knowledge59.3#11/197
Academic knowledge60.4#10/123
Document parsing59.5#14/83
Core abilities58#22/199
Instruction following63.5#7/62
Language58.6#14/62
Professional55.7#26/194
Finance58.2#13/162
Medical57.1#27/149
Legal52.2#75/173
Human preference64.2#28/354
Human preference64.2#28/354
Reasoning53.9#58/195
Science61.6#15/122
Reasoning61.2#17/147
Mathematics44.4#110/152
Coding49.3#92/179
Agentic coding49.3#90/173
Agents49.3#142/298
Web research41.9#28/35
Knowledge work53.1#75/208
Safety46.7#256/329
Secure code60.5#60/270
Toxicity avoidance55.1#102/268
Fairness48.4#134/292
Jailbreak resistance28.8#252/268
Harm refusal43.7#257/292

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Gemini 3.5 Flash, left for the other.

Mistral Large 3won 18 · lost 0
Gemini 3.5 Flash-Litewon 20 · lost 0
Inkling Smallwon 16 · lost 1
GPT-5.4 nanowon 19 · lost 2
Gemini 3.1 Flash-Litewon 16 · lost 2
Qwen3.6 Pluswon 16 · lost 2
Magistral Small 1.2won 15 · lost 2
GPT-4.1 nanowon 20 · lost 3
Command Awon 18 · lost 3
Gemma 4 31Bwon 18 · lost 3
Llama 3.3 70B Instructwon 16 · lost 3
GPT-5.4 miniwon 16 · lost 3
GPT-4o miniwon 18 · lost 4
Llama 4 Scout Instructwon 17 · lost 4
Gemini 2.0 Flashwon 17 · lost 4
Qwen3.8 27Bwon 17 · lost 4
Grok 4.3won 19 · lost 5
Kimi K2.6won 19 · lost 5
DeepSeek V3won 18 · lost 5
Gemini 2.5 Prowon 18 · lost 5
Ling 3.0 Flashwon 14 · lost 4
Gemini 1.5 Prowon 14 · lost 4
GLM-4.6won 17 · lost 5
GLM-4.7won 13 · lost 4
Grok 3won 16 · lost 5
Claude 3.5 Haikuwon 15 · lost 5
GPT OSS 120Bwon 17 · lost 6
GPT-4.1 miniwon 17 · lost 6
DeepSeek V3.2won 17 · lost 6
Inklingwon 19 · lost 7
DeepSeek R1won 16 · lost 6
GLM-4.5won 13 · lost 5
DeepSeek V4 Flashwon 18 · lost 7
Qwen3.7 Maxwon 18 · lost 7
Grok 4.1 Fastwon 15 · lost 6
MiMo V2.5 Prowon 15 · lost 6
GPT OSS 20Bwon 14 · lost 6
Claude Haiku 4.5won 16 · lost 7
Kimi K2.5won 16 · lost 7
Kimi K2 Thinkingwon 13 · lost 6
Claude 3.5 Sonnetwon 13 · lost 6
GPT-4owon 15 · lost 7
O3 Miniwon 15 · lost 7
Grok 4won 15 · lost 7
GPT-5 miniwon 16 · lost 8
GLM-5.2won 16 · lost 8
Claude Sonnet 4.5won 15 · lost 8
GPT-5 nanowon 13 · lost 7
MiniMax M3won 16 · lost 9
O4 Miniwon 14 · lost 8
Claude Opus 4.5won 12 · lost 7
Claude 3.7 Sonnetwon 13 · lost 8
Claude Opus 4won 13 · lost 8
GLM-5.1won 13 · lost 8
Gemini 3.6 Flashwon 16 · lost 10
Grok 3 Miniwon 11 · lost 7
Claude Sonnet 4won 14 · lost 9
Claude Sonnet 4.6won 14 · lost 9
GPT-6 Lunawon 15 · lost 10
DeepSeek V4 Prowon 15 · lost 10
Gemini 2.5 Flashwon 13 · lost 9
Qwen3 235B A22B Instructwon 13 · lost 9
Claude Haiku 5.5won 11 · lost 8
MiMo V2.6 Flashwon 11 · lost 8
GLM-5.3won 11 · lost 8
GPT-5.6 Lunawon 15 · lost 11
MiniMax M2.7won 12 · lost 9
GPT-5.4won 14 · lost 11
GLM-5.3 Flashwon 15 · lost 12
O1won 11 · lost 9
DeepSeek V4.1 Flashwon 11 · lost 9
GPT-4.1won 12 · lost 10
Kimi K2won 12 · lost 10
O3won 12 · lost 10
GPT-5.1won 12 · lost 10
Mistral Large 4won 12 · lost 11
GPT-5.6 Terrawon 14 · lost 13
GPT-6 Solwon 12 · lost 12
Grok 4.5won 13 · lost 13
GPT-5won 11 · lost 12
Gemini 3 Prowon 9 · lost 10
Grok 4.6won 12 · lost 14
Claude Sonnet 5won 12 · lost 14
GPT-5.2won 11 · lost 13
Claude Sonnet 5.5won 8 · lost 11
Muse Spark 1.1won 10 · lost 14
Claude Opus 4.6won 9 · lost 13
Qwen3.8 Maxwon 10 · lost 15
Grok 4.7won 9 · lost 14
Muse Spark 1.2won 7 · lost 11
MiMo V2.6 Prowon 8 · lost 13
Gemini 3.1 Prowon 8 · lost 13
GPT-6 Astrawon 7 · lost 12
Claude Opus 4.7won 9 · lost 17
GPT-6.1 Solwon 6 · lost 13
Claude Opus 4.8won 7 · lost 19
Gemini 3.8 Flashwon 7 · lost 20
Kimi K3won 5 · lost 15
Gemini 3.7 Flashwon 5 · lost 15
GPT-5.5won 6 · lost 20
GPT-5.6 Solwon 6 · lost 21
Claude Fable 5won 3 · lost 18
Claude Opus 5won 3 · lost 22
Claude Opus 5.5won 3 · lost 22
Claude Fable 5.1won 1 · lost 20

§ 3 · Sources

Where the numbers come from

9 publications, 40 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1478
GDPval-AA ↗1 measureread 2026-11-10
GDPval-AA 1212
AA-Briefcase ↗1 measureread 2026-11-10
AA-Briefcase 876
ARC-AGI-2 ↗1 measureread 2026-11-10
ARC-AGI-2 72.1%
LiveBench 1.0 ↗8 measuresread 2026-11-10
LiveBench 1.0 74.6LiveBench 1.0 · Reasoning 82LiveBench 1.0 · Coding 78.2LiveBench 1.0 · Agentic Coding 49LiveBench 1.0 · Mathematics 88.2LiveBench 1.0 · Data Analysis 64.9LiveBench 1.0 · Language 84.6LiveBench 1.0 · Instruction Following 75.6
SimpleBench ↗1 measureread 2026-11-10
SimpleBench 76.7%
Vals.ai ↗15 measuresread 2026-11-10
Vals · Legal Research Bench 30.77%Vals · LegalBench 83.6%Vals · Finance Agent 57.86%Vals · CorpFin 64.69%Vals · TaxEval 74.37%Vals · MortgageTax 68.12%Vals · MedCode 55.83%Vals · MedScribe 76.57%Vals · Web Search Index 41.36% (Exa)Vals · SWE-bench Verified 78.8% (Mini-SWE-agent)Vals · Vibe Code Bench 48.68% (OpenHands)Vals · Code Migration 26.75%Vals · GPQA Diamond 92.68%Vals · MMLU Pro 89.52%Vals · ProofBench 31%
ParseBench ↗6 measuresread 2026-11-10
ParseBench · Overall 73.22%ParseBench · Tables 90.48%ParseBench · Charts 45.27%ParseBench · Content faithfulness 88.52%ParseBench · Semantic formatting 77.87%ParseBench · Visual grounding 63.95%
Enkrypt AI Safety Leaderboard ↗6 measuresread 2026-11-10
Enkrypt · Jailbreak risk 30.6%Enkrypt · Harmful content risk 15%Enkrypt · CBRN risk 52%Enkrypt · Toxicity risk 2.7%Enkrypt · Bias risk 80.4%Enkrypt · Insecure code risk 11.6%

Badge

PublicAI Index badge for Gemini 3.5 Flash[![PublicAI Index](https://publicai.io/model-index/badge?model=gemini-3-5-flash)](https://publicai.io/model-index/m/gemini-3-5-flash)