‹ PublicAI Index
The LLM benchmark aggregator.
O1
OpenAI
Strongest in Jailbreak resistance (#4 of 268), weakest in Human preference (#130 of 354). Above par in 18 of 21 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5 and Claude Fable 5.1 and ahead of MiniMax M2.7 and Mistral Large 4.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Safety58−3.4#18/3292/3
Jailbreak resistance64.2−0.8#4/2681/1
Harm refusal59.4−2.1#14/2922/2
Safe-prompt compliance56.4−4#25/821/1
Secure code60.8−5.4#57/2701/1
Fairness52.8−17.2#84/2922/2
Toxicity avoidance55.2−3.8#95/2681/1
Coding53.9−12.3#48/1791/6
Agentic coding54.2−12.7#46/1731/5
Professional53.5−8.9#55/1941/2
Medical56.9−9.6#28/1491/1
Finance54−8.4#66/1621/1
Legal51.6−14.3#79/1731/1
Knowledge51.2−11.3#99/1971/3
Academic knowledge52.8−11.1#69/1231/1
Reasoning48.1−17.3#111/1952/5
Mathematics51.4−12.4#78/1521/2
Science48−15.5#83/1221/1
Reasoning44.8−24.2#90/1471/3
Human preference56.9−11.9#130/3541/1
Human preference56.9−11.9#130/3541/1
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for O1, left for the other.
§ 3 · Sources
Where the numbers come from
6 publications, 20 figures. Every one links to the page it was read from.
LMArena Text 1402
Aider polyglot 61.7%
SimpleBench 40.1%
Vals · LegalBench 80.39%Vals · TaxEval 74.28%Vals · MedQA 96.52%Vals · GPQA Diamond 73.23%Vals · MMLU Pro 83.49%Vals · AIME 71.46%
HELM Safety · HarmBench 96.3%HELM Safety · SimpleSafetyTests 99%HELM Safety · Anthropic Red Team 98.3%HELM Safety · BBQ 97.3%HELM Safety · XSTest 97%
Enkrypt · Jailbreak risk 0.9%Enkrypt · Harmful content risk 3.9%Enkrypt · CBRN risk 3.7%Enkrypt · Toxicity risk 2.6%Enkrypt · Bias risk 82.2%Enkrypt · Insecure code risk 11.1%
Badge
[](https://publicai.io/model-index/m/o1)