‹ PublicAI Index
The LLM benchmark aggregator.
Llama 3.1 Nemotron Ultra 253B V1
NVIDIA · 253B
Strongest in Tool use (#80 of 81), weakest in Agents (#252 of 267). Above par in 2 of 4 scopes. Among the models it meets almost everywhere, it finishes behind Gemini 3 Pro and GLM-5.2 and ahead of Mercury 2 and Claude 3.5 Haiku.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Human preference52−15.5#166/3411/1
Human preference52−15.5#166/3411/1
Agents38.8−29.3#252/2671/5
Tool use29.8−44.2#80/811/1
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Llama 3.1 Nemotron Ultra 253B V1, left for the other.
§ 3 · Sources
Where the numbers come from
2 publications, 2 figures. Every one links to the page it was read from.
LMArena Text 1348
BFCL v4 10%
Badge
[](https://publicai.io/model-index/m/llama-3-1-nemotron-ultra-253b-v1)