‹ PublicAI Index
The LLM benchmark aggregator.
WaterSheep
Other
Strongest in Calibration (#159 of 192), weakest in Routing & classification (#168 of 192). Above par in 0 of 3 scopes. Among the models it meets almost everywhere, it finishes behind Chon 1.0 12B and vLLM-SR d3 and ahead of Raw Qwen3 4B Instruct direct logits and Modernbert-jev v2.
§ 1 · Profile
What it is good at
Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.
Decisions37.8−29.1#168/1921/1
Calibration42.4−19.4#159/1921/1
Routing & classification33.3−40.7#168/1921/1
§ 2 · Head to head
What it beats, and what beats it
The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for WaterSheep, left for the other.
§ 3 · Sources
Where the numbers come from
1 publication, 2 figures. Every one links to the page it was read from.
JevBench · Intelligence 5.3%JevBench · Calibration 65.8%
Badge
[](https://publicai.io/model-index/m/watersheep)