Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Grok 4.5

SpaceXAI

Strongest in Secure code (#2 of 270), weakest in Toxicity avoidance (#189 of 268). Above par in 26 of 29 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5 and Claude Fable 5.1 and ahead of GPT-6 Sol and O3.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Core abilities59.3#15/199
General intelligence65.1#10/178
Language56.2#21/62
Instruction following56.2#22/62
Knowledge54.2#44/197
Academic knowledge60#14/123
Human preference63#46/354
Human preference63#46/354
Safety55#52/329
Secure code66#2/270
Fairness57.4#47/292
Harm refusal52.9#110/292
Jailbreak resistance52.9#143/268
Toxicity avoidance50.8#189/268
Coding53.3#53/179
Agentic coding53.5#54/173
Professional53.2#57/194
Cybersecurity55.4#21/47
IT operations39.6#29/33
Legal55.8#38/173
Medical54.4#49/149
Finance54.2#62/162
Reasoning53.3#61/195
Science61.8#12/122
Reasoning56.9#41/147
Mathematics46.6#100/152
Agents51.7#105/298
Web research38.1#31/35
Knowledge work59.7#49/208

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Grok 4.5, left for the other.

Mistral Large 3won 19 · lost 0
GPT-5.4 miniwon 20 · lost 0
Gemini 3.5 Flash-Litewon 21 · lost 0
DeepSeek V3won 24 · lost 0
Grok 4.3won 24 · lost 0
Gemini 2.5 Flashwon 22 · lost 1
Gemini 2.0 Flashwon 21 · lost 1
Grok 3won 21 · lost 1
Gemma 4 31Bwon 20 · lost 1
Grok 3 Miniwon 18 · lost 1
Ling 3.0 Flashwon 17 · lost 1
Qwen3.6 Pluswon 17 · lost 1
GPT-4.1 miniwon 22 · lost 2
Llama 4 Scout Instructwon 20 · lost 2
Command Awon 20 · lost 2
GPT OSS 20Bwon 19 · lost 2
GPT-5.4 nanowon 19 · lost 2
Llama 3.3 70B Instructwon 17 · lost 2
Inkling Smallwon 17 · lost 2
GLM-4.5won 17 · lost 2
Gemini 3.1 Flash-Litewon 16 · lost 2
GPT-4.1 nanowon 21 · lost 3
GPT OSS 120Bwon 21 · lost 3
Kimi K2.5won 21 · lost 3
Kimi K2.6won 21 · lost 3
GPT-4o miniwon 20 · lost 3
Qwen3.8 27Bwon 19 · lost 3
Grok 4.1 Fastwon 18 · lost 3
MiMo V2.5 Prowon 18 · lost 3
Gemini 1.5 Prowon 15 · lost 3
DeepSeek V3.2won 20 · lost 4
Kimi K2won 19 · lost 4
DeepSeek R1won 19 · lost 4
GLM-4.6won 19 · lost 4
GPT-4owon 18 · lost 4
GLM-5.1won 18 · lost 4
MiniMax M3won 22 · lost 5
GPT-6 Lunawon 22 · lost 5
Kimi K2 Thinkingwon 16 · lost 4
Grok 4won 18 · lost 5
DeepSeek V4 Flashwon 21 · lost 6
Claude 3.5 Haikuwon 15 · lost 5
Mistral Large 4won 18 · lost 6
Gemini 2.5 Prowon 18 · lost 6
Inklingwon 21 · lost 7
O4 Miniwon 17 · lost 6
Qwen3 235B A22B Instructwon 17 · lost 6
Claude Haiku 4.5won 16 · lost 6
Claude Sonnet 4won 17 · lost 7
GLM-5.2won 18 · lost 8
Claude 3.5 Sonnetwon 13 · lost 6
GPT-5 nanowon 14 · lost 7
MiniMax M2.7won 14 · lost 7
GPT-4.1won 15 · lost 8
DeepSeek V4 Prowon 18 · lost 10
Qwen3.7 Maxwon 16 · lost 9
O3 Miniwon 14 · lost 8
Claude Opus 4won 14 · lost 8
GPT-5 miniwon 15 · lost 9
Claude Sonnet 4.5won 15 · lost 9
Claude 3.7 Sonnetwon 13 · lost 8
Claude Sonnet 4.6won 14 · lost 9
GPT-5.6 Lunawon 17 · lost 11
GLM-5.3 Flashwon 17 · lost 11
Claude Opus 4.5won 12 · lost 8
MiMo V2.6 Flashwon 13 · lost 9
GPT-5won 14 · lost 10
Gemini 3.6 Flashwon 15 · lost 11
O1won 11 · lost 9
GPT-5.1won 12 · lost 10
O3won 12 · lost 11
GPT-6 Solwon 13 · lost 12
Claude Opus 4.6won 11 · lost 11
GPT-5.4won 13 · lost 13
Gemini 3.5 Flashwon 13 · lost 13
Qwen3.8 Maxwon 14 · lost 14
Gemini 3.8 Flashwon 14 · lost 15
Claude Sonnet 5won 13 · lost 14
GPT-5.2won 12 · lost 13
Claude Haiku 5.5won 10 · lost 11
Muse Spark 1.1won 10 · lost 14
GLM-5.3won 9 · lost 13
Grok 4.7won 10 · lost 16
Kimi K3won 8 · lost 14
Gemini 3 Prowon 7 · lost 13
DeepSeek V4.1 Flashwon 7 · lost 14
MiMo V2.6 Prowon 8 · lost 16
Muse Spark 1.2won 6 · lost 13
GPT-5.6 Terrawon 9 · lost 20
Claude Opus 4.7won 8 · lost 18
Gemini 3.1 Prowon 6 · lost 14
Gemini 3.7 Flashwon 6 · lost 15
GPT-5.6 Solwon 8 · lost 21
Claude Sonnet 5.5won 5 · lost 16
Claude Opus 5won 5 · lost 21
Grok 4.6won 5 · lost 22
GPT-5.5won 5 · lost 22
GPT-6 Astrawon 4 · lost 18
GPT-6.1 Solwon 3 · lost 18
Claude Opus 4.8won 3 · lost 23
Claude Opus 5.5won 3 · lost 23
Muse Spark 1.3won 2 · lost 16
Muse Wonderwon 2 · lost 16
Gemini 4 Argonwon 2 · lost 17
Claude Fable 5.1won 2 · lost 21
Claude Fable 5won 0 · lost 21

§ 3 · Sources

Where the numbers come from

10 publications, 38 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1466
GDPval-AA ↗1 measureread 2026-11-10
GDPval-AA 1389
AA-Briefcase ↗1 measureread 2026-11-10
AA-Briefcase 1278
Terminal-Bench ↗1 measureread 2026-11-10
Terminal-Bench 12.4% (Grok Build)
ARC-AGI-2 ↗1 measureread 2026-11-10
ARC-AGI-2 52.6%
LiveBench 1.0 ↗8 measuresread 2026-11-10
LiveBench 1.0 75.8LiveBench 1.0 · Reasoning 87.2LiveBench 1.0 · Coding 68.6LiveBench 1.0 · Agentic Coding 56.5LiveBench 1.0 · Mathematics 90.8LiveBench 1.0 · Data Analysis 73LiveBench 1.0 · Language 82.8LiveBench 1.0 · Instruction Following 71.5
Kagi LLM Benchmark ↗1 measureread 2026-11-10
Kagi LLM Benchmark 83.5%
SimpleBench ↗1 measureread 2026-11-10
SimpleBench 70%
Vals.ai ↗17 measuresread 2026-11-10
Vals · Legal Research Bench 37.98%Vals · LegalBench 85.97%Vals · Finance Agent 48.35%Vals · CorpFin 67.41%Vals · TaxEval 71.67%Vals · MortgageTax 61.8%Vals · MedCode 43.29%Vals · MedScribe 86.88%Vals · CyberBench 71.01%Vals · SRE Bench 0.76%Vals · Web Search Index 38.75% (Exa)Vals · SWE-bench Verified 86.6% (Mini-SWE-agent)Vals · Vibe Code Bench 69% (OpenHands)Vals · Code Migration 36.6%Vals · GPQA Diamond 92.93%Vals · MMLU Pro 89.22%Vals · ProofBench 31%
Enkrypt AI Safety Leaderboard ↗6 measuresread 2026-11-10
Enkrypt · Jailbreak risk 10.4%Enkrypt · Harmful content risk 0%Enkrypt · CBRN risk 25.3%Enkrypt · Toxicity risk 5.6%Enkrypt · Bias risk 66.4%Enkrypt · Insecure code risk 0.4%

Badge

PublicAI Index badge for Grok 4.5[![PublicAI Index](https://publicai.io/model-index/badge?model=grok-4-5)](https://publicai.io/model-index/m/grok-4-5)