Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Qwen3.8 Max

Alibaba

Strongest in Science (#6 of 122), weakest in Toxicity avoidance (#184 of 268). Above par in 27 of 32 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5.1 and Claude Fable 5 and ahead of MiMo V2.6 Pro and GLM-5.3.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Human preference64.7#20/354
Human preference64.7#20/354
Knowledge53.8#48/197
Academic knowledge59.2#18/123
Reasoning54.6#52/195
Science62.3#6/122
Reasoning53.7#50/147
Mathematics51.6#76/152
Professional53.5#54/194
Document design55.5#10/31
Finance57.9#18/162
Legal57.1#27/173
Cybersecurity26.3#47/47
Medical51.9#75/149
Core abilities54.3#54/199
Instruction following60.8#13/62
Data analysis56.4#14/31
Language52.1#31/62
General intelligence51.1#78/178
Coding53.2#56/179
Agentic coding53.3#55/173
Agents53.2#78/298
Knowledge work66.5#12/208
Long-horizon work44.1#17/31
Web research45.5#27/35
Computer use46.9#42/68
Safety53.1#97/329
Secure code63.6#20/270
Harm refusal52.5#117/292
Fairness48.4#134/292
Jailbreak resistance53.2#140/268
Toxicity avoidance51#184/268

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Qwen3.8 Max, left for the other.

Grok 4.3won 24 · lost 0
Gemma 4 31Bwon 24 · lost 1
DeepSeek V3won 23 · lost 1
Command Awon 21 · lost 1
Gemini 3.5 Flash-Litewon 20 · lost 1
GPT-5.4 miniwon 19 · lost 1
Qwen3.8 27Bwon 24 · lost 2
Llama 4 Scout Instructwon 20 · lost 2
Gemini 2.0 Flashwon 20 · lost 2
Grok 3won 20 · lost 2
GPT-5.4 nanowon 19 · lost 2
MiMo V2.5 Prowon 19 · lost 2
GPT-4.1 nanowon 21 · lost 3
GPT-4o miniwon 20 · lost 3
GPT OSS 20Bwon 18 · lost 3
Grok 4.1 Fastwon 18 · lost 3
Kimi K2.6won 21 · lost 4
GPT-4.1 miniwon 20 · lost 4
GPT-6 Lunawon 24 · lost 5
Gemini 2.5 Flashwon 19 · lost 4
DeepSeek V3.2won 19 · lost 4
GLM-4.6won 19 · lost 4
Mistral Large 4won 23 · lost 5
DeepSeek V4 Flashwon 22 · lost 5
GLM-5.2won 21 · lost 5
Kimi K2.5won 20 · lost 5
Kimi K2won 18 · lost 5
GLM-5.1won 17 · lost 5
Claude 3.5 Haikuwon 15 · lost 5
GPT OSS 120Bwon 18 · lost 6
Qwen3.7 Maxwon 18 · lost 6
MiniMax M3won 21 · lost 7
Inklingwon 24 · lost 8
GLM-5.3 Flashwon 24 · lost 8
DeepSeek V4 Prowon 20 · lost 7
GPT-4owon 16 · lost 6
MiMo V2.6 Flashwon 15 · lost 6
Gemini 2.5 Prowon 17 · lost 7
Claude Sonnet 4.6won 17 · lost 7
Kimi K2 Thinkingwon 14 · lost 6
Claude Haiku 4.5won 15 · lost 7
Gemini 3.6 Flashwon 17 · lost 9
Grok 4won 15 · lost 8
DeepSeek R1won 15 · lost 8
Claude Opus 4.5won 13 · lost 7
GPT-4.1won 14 · lost 8
GPT-5.6 Lunawon 17 · lost 10
MiniMax M2.7won 13 · lost 8
O1won 12 · lost 8
Claude Sonnet 4won 15 · lost 10
Gemini 3.5 Flashwon 15 · lost 10
O3 Miniwon 13 · lost 9
Claude 3.7 Sonnetwon 13 · lost 9
GPT-5 nanowon 12 · lost 9
O4 Miniwon 13 · lost 10
Qwen3 235B A22B Instructwon 13 · lost 10
Claude Sonnet 4.5won 14 · lost 11
Claude Opus 4won 12 · lost 10
GPT-5.1won 12 · lost 10
Gemini 3.8 Flashwon 17 · lost 15
GLM-5.3won 11 · lost 10
MiMo V2.6 Prowon 14 · lost 13
GPT-5 miniwon 12 · lost 12
Claude Haiku 5.5won 12 · lost 12
O3won 12 · lost 12
GPT-5won 12 · lost 12
GPT-6 Solwon 12 · lost 12
Claude Sonnet 5won 13 · lost 13
Grok 4.5won 14 · lost 14
GPT-5.4won 12 · lost 14
GPT-5.2won 11 · lost 14
Kimi K3won 11 · lost 15
Gemini 3.1 Prowon 8 · lost 12
GPT-5.6 Terrawon 12 · lost 20
Claude Opus 4.6won 8 · lost 14
Muse Spark 1.1won 9 · lost 16
Grok 4.6won 11 · lost 20
Gemini 3 Prowon 7 · lost 13
Grok 4.7won 9 · lost 20
Gemini 3.7 Flashwon 6 · lost 14
GPT-5.5won 7 · lost 18
Claude Opus 4.8won 7 · lost 18
Claude Sonnet 5.5won 6 · lost 18
GPT-6 Astrawon 6 · lost 19
GPT-5.6 Solwon 6 · lost 22
GPT-6.1 Solwon 5 · lost 19
DeepSeek V4.1 Flashwon 5 · lost 20
Claude Opus 4.7won 5 · lost 21
Muse Spark 1.3won 4 · lost 18
Claude Opus 5won 4 · lost 23
Muse Wonderwon 3 · lost 19
Gemini 4 Argonwon 3 · lost 19
Claude Opus 5.5won 3 · lost 27
Claude Fable 5won 2 · lost 20
Claude Fable 5.1won 2 · lost 24

§ 3 · Sources

Where the numbers come from

9 publications, 43 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-11-10
LMArena Text 1484
Artificial Analysis ↗1 measureread 2026-11-10
Artificial Analysis Intelligence Index 34
GDPval-AA ↗1 measureread 2026-11-10
GDPval-AA 1674
AA-Briefcase ↗1 measureread 2026-11-10
AA-Briefcase 1605
Terminal-Bench ↗1 measureread 2026-11-10
Terminal-Bench 27% (Claude Code)
LiveBench ↗8 measuresread 2026-11-10
LiveBench 60.9LiveBench · Agentic 26.6LiveBench · Reasoning 88.2LiveBench · Coding 60.9LiveBench · Browser Use 49.4LiveBench · Data Analysis 78.4LiveBench · Research 72.8LiveBench · Design 76.6
LiveBench 1.0 ↗8 measuresread 2026-11-10
LiveBench 1.0 78.5LiveBench 1.0 · Reasoning 88.2LiveBench 1.0 · Coding 72.9LiveBench 1.0 · Agentic Coding 64.6LiveBench 1.0 · Mathematics 91.3LiveBench 1.0 · Data Analysis 78.4LiveBench 1.0 · Language 79.7LiveBench 1.0 · Instruction Following 74.1
Vals.ai ↗16 measuresread 2026-11-10
Vals · Legal Research Bench 46.15%Vals · LegalBench 83.61%Vals · Harvey Legal Agent Benchmark 15.42%Vals · Finance Agent 57.87%Vals · CorpFin 65.85%Vals · TaxEval 75.55%Vals · MortgageTax 63.99%Vals · MedCode 40.67%Vals · MedScribe 84.95%Vals · CyberBench 28.57%Vals · SWE-bench Verified 85.6% (Mini-SWE-agent)Vals · Vibe Code Bench 77.14% (OpenHands)Vals · Code Migration 23.96%Vals · GPQA Diamond 93.69%Vals · MMLU Pro 88.6%Vals · ProofBench 58%
Enkrypt AI Safety Leaderboard ↗6 measuresread 2026-11-10
Enkrypt · Jailbreak risk 10.1%Enkrypt · Harmful content risk 0.6%Enkrypt · CBRN risk 26%Enkrypt · Toxicity risk 5.5%Enkrypt · Bias risk 80.4%Enkrypt · Insecure code risk 5.3%

Badge

PublicAI Index badge for Qwen3.8 Max[![PublicAI Index](https://publicai.io/model-index/badge?model=qwen3-8-max)](https://publicai.io/model-index/m/qwen3-8-max)