Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Grok 3

SpaceXAI

Strongest in Factual grounding (#23 of 104), weakest in Safety (#289 of 329). Above par in 13 of 24 scopes. Among the models it meets almost everywhere, it finishes behind O3 and Claude Opus 4.8 and ahead of Qwen3.5 Flash and GPT-4 Turbo.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Professional52.4#65/194
Legal53.3#63/173
Finance54#65/162
Medical50.2#86/149
Core abilities52.9#68/199
General intelligence54.2#56/178
Coding52.1#71/179
Agentic coding52.2#67/173
Knowledge49.3#121/197
Academic knowledge48.4#85/123
Human preference57.7#122/354
Human preference57.7#122/354
Reasoning44.9#143/195
Science48.7#82/122
Mathematics48#95/152
Reasoning40.4#120/147
Safety44.1#289/329
Factual grounding60.5#23/104
Safe-prompt compliance55.1#34/82
Fairness51.4#96/292
Secure code40.8#211/270
Harm refusal43.5#259/292
Toxicity avoidance26#263/268
Jailbreak resistance26#268/268

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Grok 3, left for the other.

Mistral Medium 3.5won 13 · lost 2
Mistral Large 3won 15 · lost 3
Gemini 2.0 Flashwon 18 · lost 5
Command R+won 14 · lost 4
GPT-4o miniwon 17 · lost 5
Llama 4 Scout Instructwon 17 · lost 5
Command Awon 17 · lost 5
GPT-4.1 nanowon 17 · lost 6
Gemini 1.5 Prowon 14 · lost 5
Jamba 1.6 Miniwon 11 · lost 4
Llama 3.3 70B Instructwon 13 · lost 5
Claude 3.5 Haikuwon 13 · lost 5
DeepSeek V3won 17 · lost 7
Gemini 1.5 Flashwon 12 · lost 5
Jamba 1.6 Largewon 10 · lost 5
Magistral Small 1.2won 10 · lost 5
Gemini 2.5 Flash-Litewon 12 · lost 6
GPT-5.4 nanowon 12 · lost 6
GPT-4.1 miniwon 15 · lost 8
Inkling Smallwon 10 · lost 6
Gemini 3.5 Flash-Litewon 10 · lost 6
GPT OSS 20Bwon 12 · lost 8
Claude 3.5 Sonnetwon 12 · lost 8
GPT-4owon 13 · lost 9
GPT OSS 120Bwon 14 · lost 10
Gemma 4 31Bwon 11 · lost 8
MiniMax M2.1won 9 · lost 7
MiniMax M2.5won 10 · lost 8
Grok 4 Fastwon 10 · lost 8
GPT-4 Turbowon 8 · lost 7
Qwen3.5 Flashwon 8 · lost 7
Claude Haiku 4.5won 11 · lost 11
O3 Miniwon 10 · lost 11
Gemini 3.1 Flash-Litewon 8 · lost 9
GPT-5.4 miniwon 8 · lost 9
O1 Miniwon 7 · lost 8
Kimi K2won 11 · lost 13
GPT-5 nanowon 10 · lost 12
Ling 3.0 Flashwon 7 · lost 9
GLM-4.7won 7 · lost 9
Grok 4.1 Fastwon 9 · lost 12
GLM-4.5won 8 · lost 11
GLM-4.6won 9 · lost 13
Grok 4.3won 8 · lost 12
DeepSeek V3.2won 9 · lost 14
Kimi K2.6won 8 · lost 13
DeepSeek V3.1won 6 · lost 10
Qwen3.8 27Bwon 6 · lost 10
Grok 4.20won 6 · lost 10
GPT-4.1won 9 · lost 15
MiMo V2.5 Prowon 7 · lost 12
MiniMax M3won 8 · lost 14
MiniMax M2.7won 7 · lost 13
GPT-6 Lunawon 7 · lost 13
GLM-5.1won 7 · lost 13
Qwen3 Maxwon 5 · lost 10
GLM-5won 6 · lost 12
Grok 4won 7 · lost 14
Gemini 2.5 Flashwon 8 · lost 16
Qwen3 235B A22B Instructwon 8 · lost 16
DeepSeek V4 Flashwon 7 · lost 15
Kimi K2.5won 7 · lost 16
Claude 3.7 Sonnetwon 6 · lost 14
O4 Miniwon 7 · lost 17
Claude Sonnet 4won 7 · lost 17
Qwen3.7 Maxwon 6 · lost 15
Gemini 3.6 Flashwon 6 · lost 15
MiMo V2.6 Flashwon 5 · lost 13
Inklingwon 6 · lost 16
GLM-5.3 Flashwon 6 · lost 16
Mistral Large 4won 5 · lost 14
DeepSeek R1won 6 · lost 17
DeepSeek V4 Prowon 6 · lost 17
Gemini 3 Flashwon 4 · lost 12
Claude Sonnet 4.6won 5 · lost 15
GPT-5 miniwon 6 · lost 18
O1won 5 · lost 16
Gemini 3.5 Flashwon 5 · lost 16
Gemini 3.8 Flashwon 5 · lost 17
Grok 3 Miniwon 4 · lost 14
Claude Sonnet 4.5won 5 · lost 18
Claude Opus 4won 5 · lost 19
Gemini 3 Prowon 4 · lost 17
Claude Opus 4.6won 4 · lost 17
GPT-6 Astrawon 3 · lost 13
GLM-5.3won 3 · lost 13
GLM-5.2won 4 · lost 18
Gemini 3.1 Prowon 3 · lost 14
GPT-5.2won 4 · lost 19
Claude Opus 4.5won 3 · lost 15
MiMo V2.6 Prowon 3 · lost 16
Kimi K2 Thinkingwon 3 · lost 17
GPT-6 Solwon 3 · lost 17
GPT-5.6 Lunawon 3 · lost 19
GPT-5.1won 3 · lost 19
GPT-5won 3 · lost 21
Gemini 2.5 Prowon 3 · lost 21
Grok 4.7won 2 · lost 17
Muse Spark 1.1won 2 · lost 18
GPT-5.6 Terrawon 2 · lost 20
Qwen3.8 Maxwon 2 · lost 20
GPT-5.4won 2 · lost 21
Claude Opus 4.7won 2 · lost 21
Gemini 4 Argonwon 1 · lost 14
Kimi K3won 1 · lost 15
Claude Sonnet 5won 1 · lost 20
Claude Opus 5won 1 · lost 20
Claude Opus 5.5won 1 · lost 20
Grok 4.6won 1 · lost 21
Grok 4.5won 1 · lost 21
GPT-5.5won 1 · lost 22
GPT-5.6 Solwon 1 · lost 22
Gemini 3.7 Flashwon 0 · lost 15
DeepSeek V4.1 Flashwon 0 · lost 16
Claude Fable 5.1won 0 · lost 16
Claude Fable 5won 0 · lost 16
Claude Opus 4.8won 0 · lost 22
O3won 0 · lost 23

§ 3 · Sources

Where the numbers come from

9 publications, 24 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1411
ARC-AGI-2 ↗1 measureread 2026-11-10
ARC-AGI-2 0%
Aider polyglot ↗1 measureread 2026-11-10
Aider polyglot 53.3%
Kagi LLM Benchmark ↗1 measureread 2026-11-10
Kagi LLM Benchmark 61.3%
SimpleBench ↗1 measureread 2026-11-10
SimpleBench 36.1%
Vals.ai ↗7 measuresread 2026-11-10
Vals · LegalBench 82.59%Vals · CorpFin 59.71%Vals · TaxEval 75.88%Vals · MedQA 83.85%Vals · GPQA Diamond 74.24%Vals · MMLU Pro 79.95%Vals · AIME 58.75%
HELM Safety ↗5 measuresread 2026-11-10
HELM Safety · HarmBench 45.3%HELM Safety · SimpleSafetyTests 96.8%HELM Safety · Anthropic Red Team 95.5%HELM Safety · BBQ 93.6%HELM Safety · XSTest 96.4%
Enkrypt AI Safety Leaderboard ↗6 measuresread 2026-11-10
Enkrypt · Jailbreak risk 68.2%Enkrypt · Harmful content risk 59.4%Enkrypt · CBRN risk 12%Enkrypt · Toxicity risk 38.3%Enkrypt · Bias risk 80.6%Enkrypt · Insecure code risk 52%
Vectara · Factual consistency 94.2%

Badge

PublicAI Index badge for Grok 3[![PublicAI Index](https://publicai.io/model-index/badge?model=grok-3)](https://publicai.io/model-index/m/grok-3)