‹ PublicAI Index
The LLM benchmark aggregator.
DeepSeek V4 Flash
DeepSeek
Strongest in Cybersecurity (#18 of 47), weakest in Safety (#267 of 329). Above par in 16 of 32 scopes. Among the models it meets almost everywhere, it finishes behind Claude Opus 4.8 and DeepSeek V4.1 Flash and ahead of Kimi K2.6 and Mistral Large 4.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Agents56.2−10.2#44/2982/6
Knowledge work59.9−10.8#47/2082/2
Workflow automation32−34—/0✱✱
Coding54.2−12#47/1792/6
Agentic coding54.3−12.6#45/1732/5
Code generation40.2−25.1—/20✱0/1
Repository Q&A41.1−25.6—/0✱✱
Reasoning52.7−12.7#73/1954/5
Science59.6−3.9#27/1221/1
Reasoning55.1−13.9#44/1472/3
Mathematics47.4−16.4#96/1522/2
Expert reasoning33.8−32.6—/0✱✱
Knowledge52.6−9.9#76/1971/3
Academic knowledge56.2−7.7#46/1231/1
Human preference60.4−8.4#83/3541/1
Human preference60.4−8.4#83/3541/1
Professional50.4−12#88/1941/2
Cybersecurity56.4−7.5#18/471/1
Biology research42.4−28.3#25/311/1
Finance52.5−9.9#79/1621/1
Medical50.2−16.3#84/1491/1
Legal49.1−16.8#97/1731/1
Core abilities49.1−16.2#110/1992/4
Language51.5−15.1#34/621/1
Instruction following45.6−28.2#40/621/1
General intelligence49.7−19.7#92/1781/3
Safety46.1−15.3#267/3291/3
Secure code49.2−17#161/2701/1
Fairness45.2−24.8#187/2921/2
Harm refusal46.6−14.9#207/2921/2
Jailbreak resistance40.2−24.8#215/2681/1
Toxicity avoidance46.7−12.3#217/2681/1
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for DeepSeek V4 Flash, left for the other.
§ 3 · Sources
Where the numbers come from
10 publications, 49 figures. Every one links to the page it was read from.
LMArena Text 1439
GDPval-AA 1441
AA-Briefcase 1255
ARC-AGI-2 61.4%
LiveBench 1.0 74.2LiveBench 1.0 · Reasoning 86.6LiveBench 1.0 · Coding 75LiveBench 1.0 · Agentic Coding 46.8LiveBench 1.0 · Mathematics 86.8LiveBench 1.0 · Data Analysis 79.3LiveBench 1.0 · Language 79.2LiveBench 1.0 · Instruction Following 65.5
Kagi LLM Benchmark 52.2%
SimpleBench 61.1%
Vals · Legal Research Bench 30.29%Vals · LegalBench 77.71%Vals · Finance Agent 49.52%Vals · CorpFin 61.85%Vals · TaxEval 70.69%Vals · MedCode 41.41%Vals · MedScribe 80.36%Vals · BioMysteryBench 64.44%Vals · CyberBench 72.08%Vals · SWE-bench Verified 88.8% (Mini-SWE-agent)Vals · Vibe Code Bench 74.74% (OpenHands)Vals · Code Migration 38.63%Vals · GPQA Diamond 89.9%Vals · MMLU Pro 86.21%Vals · ProofBench 56%
Enkrypt · Jailbreak risk 21%Enkrypt · Harmful content risk 23.3%Enkrypt · CBRN risk 29.7%Enkrypt · Toxicity risk 8.4%Enkrypt · Bias risk 85.3%Enkrypt · Insecure code risk 34.7%
GPQA Diamond (Pass@1) 89.9%Codeforces (Rating) 3289MathArena Apex (Pass@1) 58.6%Terminal-Bench 2.1 (Pass@1) 82.7%Terminal-Bench 3.0 (Pass@1) 7.6%Terminal-Bench 4.0 (Pass@1) 7%DeepSWE v1.1 (Resolved) 54.4%NL2Repo-Bench (Score) 54.2%CyberGym (Pass@1) 76.7%SEC-Bench Pro (Pass@1) 30.9%ExploitGym (Pass@1) 1.8%HLE w/ tools (Pass@1) 51.5%AutomationBench (Pass@1) 37.7%Agent's Last Exam (Pass@1) 25.2%
Badge
[](https://publicai.io/model-index/m/deepseek-v4-flash)