‹ PublicAI Index
The LLM benchmark aggregator.
O3 Mini
OpenAI
Strongest in Code generation (#7 of 20), weakest in Agents (#283 of 298). Above par in 13 of 24 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5 and Claude Fable 5.1 and ahead of Grok 3 and O1 Mini.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Coding55−11.2#37/1792/6
Code generation57.2−8.1#7/201/1
Agentic coding53.9−13#49/1731/5
Safety55.3−6.1#46/3292/3
Harm refusal57.3−4.2#29/2922/2
Jailbreak resistance60.4−4.6#39/2681/1
Safe-prompt compliance49.9−10.5#56/821/1
Secure code58−8.2#83/2701/1
Fairness51.2−18.8#98/2922/2
Toxicity avoidance52.3−6.7#165/2681/1
Reasoning45.9−19.5#129/1953/5
Mathematics55.4−8.4#48/1521/2
Science49.6−13.9#77/1221/1
Reasoning36.6−32.4#136/1472/3
Professional47.3−15.1#132/1941/2
Medical56−10.5#34/1491/1
Legal44.9−21#121/1731/1
Finance42.8−19.6#132/1621/1
Knowledge48.7−13.8#133/1971/3
Academic knowledge46.8−17.1#94/1231/1
Human preference53.2−15.6#164/3541/1
Human preference53.2−15.6#164/3541/1
Agents40.4−26#283/2982/6
Knowledge work34.6−36.1#186/2082/2
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for O3 Mini, left for the other.
§ 3 · Sources
Where the numbers come from
10 publications, 25 figures. Every one links to the page it was read from.
LMArena Text 1364
GDPval-AA 238
AA-Briefcase 142
ARC-AGI-2 3%
LiveCodeBench 67.4%
Aider polyglot 60.4%
SimpleBench 22.8%
Vals · LegalBench 71.54%Vals · CorpFin 45.3%Vals · TaxEval 69.42%Vals · MedQA 94.83%Vals · GPQA Diamond 75.5%Vals · MMLU Pro 78.69%Vals · AIME 86.46%
HELM Safety · HarmBench 95.2%HELM Safety · SimpleSafetyTests 99%HELM Safety · Anthropic Red Team 98.6%HELM Safety · BBQ 94.1%HELM Safety · XSTest 94.1%
Enkrypt · Jailbreak risk 4.1%Enkrypt · Harmful content risk 15.6%Enkrypt · CBRN risk 8.3%Enkrypt · Toxicity risk 4.6%Enkrypt · Bias risk 81.9%Enkrypt · Insecure code risk 16.9%
Badge
[](https://publicai.io/model-index/m/o3-mini)