‹ PublicAI Index
The LLM benchmark aggregator.
O1 Mini
OpenAI
Strongest in Jailbreak resistance (#23 of 268), weakest in Human preference (#190 of 354). Above par in 11 of 15 scopes. Among the models it meets almost everywhere, it finishes behind GPT-5 and O3 and ahead of Claude Haiku 4.5 and Grok 3.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Safety56.6−4.8#29/3292/3
Jailbreak resistance61.9−3.1#23/2681/1
Safe-prompt compliance56.4−4#25/821/1
Harm refusal56.9−4.6#35/2922/2
Secure code59.9−6.3#67/2701/1
Fairness53−17#82/2922/2
Toxicity avoidance55.1−3.9#102/2681/1
Professional51.3−11.1#83/1941/2
Medical53.6−12.9#59/1491/1
Coding47.7−18.5#102/1791/6
Agentic coding47.5−19.4#100/1731/5
Reasoning39.5−25.9#172/1952/5
Reasoning34.9−34.1#143/1472/3
Human preference50.6−18.2#190/3541/1
Human preference50.6−18.2#190/3541/1
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for O1 Mini, left for the other.
§ 3 · Sources
Where the numbers come from
7 publications, 16 figures. Every one links to the page it was read from.
LMArena Text 1337
ARC-AGI-2 0.8%
Aider polyglot 32.9%
SimpleBench 18.1%
Vals · MedQA 90.22%
HELM Safety · HarmBench 88.5%HELM Safety · SimpleSafetyTests 97%HELM Safety · Anthropic Red Team 98.3%HELM Safety · BBQ 96.9%HELM Safety · XSTest 97%
Enkrypt · Jailbreak risk 2.8%Enkrypt · Harmful content risk 7.2%Enkrypt · CBRN risk 7.3%Enkrypt · Toxicity risk 2.7%Enkrypt · Bias risk 80.9%Enkrypt · Insecure code risk 12.9%
Badge
[](https://publicai.io/model-index/m/o1-mini)