‹ PublicAI Index
The LLM benchmark aggregator.
GPT-5.1
OpenAI
Strongest in Legal (#3 of 173), weakest in Toxicity avoidance (#156 of 268). Above par in 18 of 24 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5 and Claude Fable 5.1 and ahead of GLM-5.1 and MiMo V2.6 Pro.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Professional58.6−3.8#6/1941/2
Legal63.7−2.2#3/1731/1
Medical61−5.5#6/1491/1
Finance54.6−7.8#55/1621/1
Safety57.2−4.2#23/3293/3
Safe-prompt compliance59.1−1.3#10/821/1
Secure code64.3−1.9#16/2701/1
Harm refusal58.6−2.9#19/2922/2
Fairness58.2−11.8#45/2922/2
Factual grounding44.5−26.2#80/1041/1
Jailbreak resistance56.7−8.3#88/2681/1
Toxicity avoidance52.6−6.4#156/2681/1
Human preference62−6.8#59/3541/1
Human preference62−6.8#59/3541/1
Reasoning53.2−12.2#64/1953/5
Mathematics57.2−6.6#30/1521/2
Science57.4−6.1#41/1221/1
Reasoning47.7−21.3#78/1472/3
Knowledge52.7−9.8#72/1971/3
Academic knowledge56.4−7.5#41/1231/1
Coding45.8−20.4#117/1791/6
Agentic coding45.5−21.4#113/1731/5
Agents50−16.4#125/2981/6
Knowledge work50−20.7#96/2081/2
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for GPT-5.1, left for the other.
§ 3 · Sources
Where the numbers come from
8 publications, 29 figures. Every one links to the page it was read from.
LMArena Text 1455
GDPval-AA 834
ARC-AGI-2 17.6%
SimpleBench 53.2%
Vals · CaseLaw 73.42%Vals · LegalBench 85.68%Vals · CorpFin 63.83%Vals · TaxEval 74.86%Vals · MortgageTax 61.37%Vals · MedQA 96.38%Vals · MedCode 52.73%Vals · MedScribe 88.09%Vals · SWE-bench Verified 69.8% (Mini-SWE-agent)Vals · Vibe Code Bench 24.61% (OpenHands)Vals · GPQA Diamond 86.62%Vals · MMLU Pro 86.38%Vals · AIME 93.33%
HELM Safety · HarmBench 97.6%HELM Safety · SimpleSafetyTests 99.8%HELM Safety · Anthropic Red Team 99.5%HELM Safety · BBQ 88.7%HELM Safety · XSTest 98.2%
Enkrypt · Jailbreak risk 7.2%Enkrypt · Harmful content risk 16.1%Enkrypt · CBRN risk 6.5%Enkrypt · Toxicity risk 4.4%Enkrypt · Bias risk 56.3%Enkrypt · Insecure code risk 4%
Vectara · Factual consistency 87.9%
Badge
[](https://publicai.io/model-index/m/gpt-5-1)