Request a pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Arbiter 4B

Other · 4B

Strongest in Decisions (#125 of 192), weakest in Calibration (#133 of 192). Above par in 1 of 3 scopes. Among the models it meets almost everywhere, it finishes behind Chon 1.0 12B and vLLM-SR d3 and ahead of Nev 2B and ZeroEntropy zerank-2.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Decisions47.9#125/192
Routing & classification45.5#126/192
Calibration50.3#133/192

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Arbiter 4B, left for the other.

Laya 322Mwon 2 · lost 0
CLM 8Bwon 3 · lost 0
Laya multilingualwon 3 · lost 0
Julia 1won 3 · lost 0
Raw Qwen3 1.7B direct logitswon 3 · lost 0
Raw Qwen3 0.6B direct logitswon 3 · lost 0
ClassOne Qwen 3.5 2Bwon 3 · lost 0
Deem 0.8B v1won 3 · lost 0
Tacet Sonatawon 3 · lost 0
ClassOne Gemma 4 E2Bwon 3 · lost 0
Mirrorwon 3 · lost 0
openJev Verdictwon 3 · lost 0
Phocinae Largha 150M V1won 3 · lost 0
SimpleJevwon 3 · lost 0
Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads)won 3 · lost 0
Raw Qwen3 8B direct logitswon 3 · lost 0
Quyet 1.0 Smallwon 3 · lost 0
Layawon 3 · lost 0
kev 0.5Bwon 3 · lost 0
Liquid AI d1-omni-600Mwon 3 · lost 0
Vega 0.8Bwon 3 · lost 0
Raw Phi-4 mini direct logitswon 3 · lost 0
Modernbert-jev v2won 3 · lost 0
WaterSheepwon 3 · lost 0
Open Jev Deberta V3 Largewon 3 · lost 0
ClassOne Qwen 3.5 4Bwon 3 · lost 0
Vega 4Bwon 3 · lost 0
kev 0.6Bwon 3 · lost 0
OpenDecisionwon 3 · lost 0
Verdict Smallwon 3 · lost 0
Quyet 1.0 Small ENwon 3 · lost 0
openJev Verdict 1.4won 3 · lost 0
Decision Fastwon 3 · lost 0
Krino 2Bwon 3 · lost 0
kev 4Bwon 3 · lost 0
Smalljev semantic-v9won 3 · lost 0
Decider 2Bwon 3 · lost 0
Qwen3 Reranker 4Bwon 3 · lost 0
Nemotron Diffusion 8Bwon 3 · lost 0
Open-Jev 2Bwon 3 · lost 0
OpenSourceJevwon 3 · lost 0
Open Alternative Jevwon 3 · lost 0
Liquid AI d1-3Bwon 3 · lost 0
System Onewon 2 · lost 1
Raw Qwen3 4B Instruct direct logitswon 2 · lost 1
ClassOne Gemma 4 E4Bwon 2 · lost 1
Watt Flash 0.1won 2 · lost 1
Decisor 4Bwon 2 · lost 1
Alibaba GTE Reranker ModernBERT-basewon 2 · lost 1
Qwen3.5-0.8B Decision Modelwon 2 · lost 1
Jul fastwon 2 · lost 1
Gutsy 0.8B v0.3won 2 · lost 1
PurpleMIST Mini 1.0won 2 · lost 1
Lev 350Mwon 2 · lost 1
Certo v1won 2 · lost 1
Vega Uwon 2 · lost 1
Laya typed-decisionswon 2 · lost 1
Mixedbread mxbai-rerank-base-v2won 2 · lost 1
BAAI bge-reranker-v2-m3won 2 · lost 1
JADEwon 2 · lost 1
Open Jev JSON Canvaswon 2 · lost 1
Jiwo 0.8bwon 2 · lost 1
Malkuth 2Bwon 2 · lost 1
ClassOne Qwen 3.5 9Bwon 2 · lost 1
EXAONE-4.0-1.2B-JEV v0.3won 2 · lost 1
kev 8Bwon 2 · lost 1
ZeroEntropy zerank-2won 2 · lost 1
Nev 2Bwon 2 · lost 1
Spark S1 4B V6won 1 · lost 2
Nomawon 1 · lost 2
Imajev 2Bwon 1 · lost 2
APUS OpenJev V1 9Bwon 1 · lost 2
Bespoke Nimble 9Bwon 1 · lost 2
Diffusion Jevwon 1 · lost 2
local-jev Qwen3.5-4Bwon 1 · lost 2
Decision 2Bwon 1 · lost 2
SemIfwon 1 · lost 2
Jev Localwon 1 · lost 2
Messier One v0.2won 1 · lost 2
RYOTIDE Qwenwon 1 · lost 2
Decider 4Bwon 1 · lost 2
Quyet 1.0won 1 · lost 2
Messier One v0.4won 1 · lost 2
Bespoke Nimble 9B v3won 1 · lost 2
Djev Sparkwon 0 · lost 2
Jev 1.13.0won 0 · lost 2
Gemma 4 31Bwon 0 · lost 2
RYOTIDE Qwen9won 0 · lost 3
Standard One 3B SHwon 0 · lost 3
ArseneLupin v1.1won 0 · lost 3
TypeCastLM 1.4.0won 0 · lost 3
Compass 0.2.0won 0 · lost 3
Typecastlmwon 0 · lost 3
Uniphore 4B Deciderwon 0 · lost 3
CoCo Decision 4Bwon 0 · lost 3
Jebadiah 9B v2won 0 · lost 3
JEV Qwen3.5-9B Basewon 0 · lost 3
Decision 4B v1.1won 0 · lost 3
Pjev 2Bwon 0 · lost 3
Clef Omniwon 0 · lost 3
Manchego v2.1won 0 · lost 3
Standard One 8Bwon 0 · lost 3
Decision 4Bwon 0 · lost 3
Wald 4Bwon 0 · lost 3
reflex 4Bwon 0 · lost 3
Verdin 4Bwon 0 · lost 3
Standard One 8B SHwon 0 · lost 3
Qwen3.5-9B Jev-like data-mix v2won 0 · lost 3
Jiwo 4bwon 0 · lost 3
Decision 4B v1.2won 0 · lost 3
Open-Jev 9Bwon 0 · lost 3
Levwon 0 · lost 3
Malkuth 4Bwon 0 · lost 3
Kahn1 4Bwon 0 · lost 3
Pplx Decider Flash V1.2won 0 · lost 3
Metask Jev 4Bwon 0 · lost 3
Decision 2.0 Lux 9Bwon 0 · lost 3
Blink 4Bwon 0 · lost 3
JEB 35B A3Bwon 0 · lost 3
Imajev 4Bwon 0 · lost 3
Jqvwon 0 · lost 3
Imajev 9Bwon 0 · lost 3
Hopperwon 0 · lost 3
janus 4Bwon 0 · lost 3
JevK5 v0.2.0won 0 · lost 3
Seb 9Bwon 0 · lost 3
Clef Flashwon 0 · lost 3
Jebadiah 9B v2.1won 0 · lost 3
deck-4B v1.0won 0 · lost 3
JPT 4Bwon 0 · lost 3
JevK5 v0.3won 0 · lost 3
Shisa De 1won 0 · lost 3
Arcbright Elf 1 12Bwon 0 · lost 3
Metask rain 4Bwon 0 · lost 3
Decider-4b v2won 0 · lost 3
Plumb 4Bwon 0 · lost 3
Decider 35B A3Bwon 0 · lost 3
Bev / Bonsai 27Bwon 0 · lost 3
LitJevwon 0 · lost 3
Open-Jev 27B v1.1won 0 · lost 3
NInfer Qwen3.8-27Bwon 0 · lost 3
Chon 1.0 E4Bwon 0 · lost 3
Aplomb 1won 0 · lost 3
Hopper 12B trainedwon 0 · lost 3
Respan Span-02won 0 · lost 3
SPX CD Omniwon 0 · lost 3
Wald 4B v2.1won 0 · lost 3
JevOnewon 0 · lost 3
Jebadiah 27Bwon 0 · lost 3
decider chat on Gemma-4-31B-itwon 0 · lost 3
decisio v0.9.0 on gemma-4-12B-itwon 0 · lost 3
NInfer Qwen3.8-Flash-Next mixedwon 0 · lost 3
Blink v0.3 26B-A4Bwon 0 · lost 3
GEV 26B Decidewon 0 · lost 3
Decision 2.0 Vega 27Bwon 0 · lost 3
Winnow-12B Q8won 0 · lost 3
Cygnetwon 0 · lost 3
JPT 35B A3Bwon 0 · lost 3
decisio v0.8.0 on gemma-4-12B-itwon 0 · lost 3
Torchcast Decision 12Bwon 0 · lost 3
Jev Omniwon 0 · lost 3
AutoJev 27Bwon 0 · lost 3
decider-12b v1, stock Gemma-4-12B-itwon 0 · lost 3
Decider-12b v2won 0 · lost 3
Xor 26B-A4Bwon 0 · lost 3
Torchcast Decision 4Bwon 0 · lost 3
swanOnewon 0 · lost 3
Bobcat Flash 1.2won 0 · lost 3
RSI-Jev v6.1-VL 27Bwon 0 · lost 3
Nagi-ENORMOUS 27Bwon 0 · lost 3
Surogate Rune 26B-A4B v3won 0 · lost 3
JEV 27Bwon 0 · lost 3
OpenJevwon 0 · lost 3
H2O-Lightning-4B v1.1won 0 · lost 3
SimpleJev Qwen3.8-27Bwon 0 · lost 3
Clefwon 0 · lost 3
René-1 31Bwon 0 · lost 3
Deck 31Bwon 0 · lost 3
Eikos 27Bwon 0 · lost 3
Metask Jev Rain 12B Trainedwon 0 · lost 3
Metask Jev Rain 31B Trainedwon 0 · lost 3
metask-jev-rain-31B-trained service v3won 0 · lost 3
decisio v0.8.0 on gemma-4-31B-itwon 0 · lost 3
Kev 27Bwon 0 · lost 3
StartLux-Decision v1.1 27B AutoThinkwon 0 · lost 3
Jeff 1.0 Largewon 0 · lost 3
Quyet 1.0 Largewon 0 · lost 3
Torchcast Decision 27Bwon 0 · lost 3
Pplx Decider V1.2won 0 · lost 3
vLLM-SR d3-turbowon 0 · lost 3
Basal Omni 1.0 Ultrawon 0 · lost 3
Perplexity Decider v1.1 27Bwon 0 · lost 3
StartLux-Decision v1.1 27B Instantwon 0 · lost 3
vLLM-SR d3won 0 · lost 3
Chon 1.0 12Bwon 0 · lost 3

§ 3 · Sources

Where the numbers come from

1 publication, 2 figures. Every one links to the page it was read from.

JevBench ↗2 measuresread 2026-10-21
JevBench · Intelligence 27.4%JevBench · Calibration 77.2%

Badge

PublicAI Index badge for Arbiter 4B[![PublicAI Index](https://publicai.io/model-index/badge?model=arbiter-4b)](https://publicai.io/model-index/m/arbiter-4b)