The LLM benchmark aggregator.

Bespoke Nimble 9B v3

Other · 9B

Strongest in Routing & classification (#39 of 192), weakest in Calibration (#135 of 192). Above par in 3 of 3 scopes. Among the models it meets almost everywhere, it finishes behind Chon 1.0 12B and vLLM-SR d3 and ahead of Decider-4b v2 and Metask rain 4B.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Decisions55.8−11.1#61/1921/1

Routing & classification61.5−12.5#39/1921/1

Calibration50.2−11.6#135/1921/1

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Bespoke Nimble 9B v3, left for the other.

Laya 322Mwon 2 · lost 0

Djev Sparkwon 2 · lost 0

CLM 8Bwon 3 · lost 0

Laya multilingualwon 3 · lost 0

Julia 1won 3 · lost 0

Raw Qwen3 1.7B direct logitswon 3 · lost 0

Raw Qwen3 0.6B direct logitswon 3 · lost 0

ClassOne Qwen 3.5 2Bwon 3 · lost 0

Deem 0.8B v1won 3 · lost 0

Tacet Sonatawon 3 · lost 0

ClassOne Gemma 4 E2Bwon 3 · lost 0

Mirrorwon 3 · lost 0

openJev Verdictwon 3 · lost 0

Phocinae Largha 150M V1won 3 · lost 0

SimpleJevwon 3 · lost 0

Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads)won 3 · lost 0

Raw Qwen3 8B direct logitswon 3 · lost 0

Quyet 1.0 Smallwon 3 · lost 0

Layawon 3 · lost 0

kev 0.5Bwon 3 · lost 0

Liquid AI d1-omni-600Mwon 3 · lost 0

Vega 0.8Bwon 3 · lost 0

System Onewon 3 · lost 0

Raw Phi-4 mini direct logitswon 3 · lost 0

Modernbert-jev v2won 3 · lost 0

Raw Qwen3 4B Instruct direct logitswon 3 · lost 0

WaterSheepwon 3 · lost 0

Open Jev Deberta V3 Largewon 3 · lost 0

ClassOne Qwen 3.5 4Bwon 3 · lost 0

ClassOne Gemma 4 E4Bwon 3 · lost 0

Vega 4Bwon 3 · lost 0

kev 0.6Bwon 3 · lost 0

OpenDecisionwon 3 · lost 0

Verdict Smallwon 3 · lost 0

Quyet 1.0 Small ENwon 3 · lost 0

openJev Verdict 1.4won 3 · lost 0

Decision Fastwon 3 · lost 0

Krino 2Bwon 3 · lost 0

Decisor 4Bwon 3 · lost 0

kev 4Bwon 3 · lost 0

Decider 2Bwon 3 · lost 0

Qwen3 Reranker 4Bwon 3 · lost 0

JADEwon 3 · lost 0

Nemotron Diffusion 8Bwon 3 · lost 0

Open-Jev 2Bwon 3 · lost 0

ClassOne Qwen 3.5 9Bwon 3 · lost 0

OpenSourceJevwon 3 · lost 0

Open Alternative Jevwon 3 · lost 0

kev 8Bwon 3 · lost 0

Liquid AI d1-3Bwon 3 · lost 0

Spark S1 4B V6won 3 · lost 0

APUS OpenJev V1 9Bwon 3 · lost 0

Bespoke Nimble 9Bwon 3 · lost 0

Diffusion Jevwon 3 · lost 0

Jev Localwon 3 · lost 0

Messier One v0.2won 3 · lost 0

Quyet 1.0won 3 · lost 0

Messier One v0.4won 3 · lost 0

Watt Flash 0.1won 2 · lost 1

Alibaba GTE Reranker ModernBERT-basewon 2 · lost 1

Qwen3.5-0.8B Decision Modelwon 2 · lost 1

Jul fastwon 2 · lost 1

Smalljev semantic-v9won 2 · lost 1

Gutsy 0.8B v0.3won 2 · lost 1

PurpleMIST Mini 1.0won 2 · lost 1

Lev 350Mwon 2 · lost 1

Certo v1won 2 · lost 1

Vega Uwon 2 · lost 1

Laya typed-decisionswon 2 · lost 1

Mixedbread mxbai-rerank-base-v2won 2 · lost 1

BAAI bge-reranker-v2-m3won 2 · lost 1

Open Jev JSON Canvaswon 2 · lost 1

Jiwo 0.8bwon 2 · lost 1

Malkuth 2Bwon 2 · lost 1

EXAONE-4.0-1.2B-JEV v0.3won 2 · lost 1

ZeroEntropy zerank-2won 2 · lost 1

Nev 2Bwon 2 · lost 1

Arbiter 4Bwon 2 · lost 1

RYOTIDE Qwen9won 2 · lost 1

Nomawon 2 · lost 1

Imajev 2Bwon 2 · lost 1

Standard One 3B SHwon 2 · lost 1

ArseneLupin v1.1won 2 · lost 1

local-jev Qwen3.5-4Bwon 2 · lost 1

Decision 2Bwon 2 · lost 1

SemIfwon 2 · lost 1

TypeCastLM 1.4.0won 2 · lost 1

Compass 0.2.0won 2 · lost 1

Typecastlmwon 2 · lost 1

Uniphore 4B Deciderwon 2 · lost 1

CoCo Decision 4Bwon 2 · lost 1

Jebadiah 9B v2won 2 · lost 1

RYOTIDE Qwenwon 2 · lost 1

Decider 4Bwon 2 · lost 1

JEV Qwen3.5-9B Basewon 2 · lost 1

Decision 4B v1.1won 2 · lost 1

Pjev 2Bwon 2 · lost 1

Clef Omniwon 2 · lost 1

Manchego v2.1won 2 · lost 1

Standard One 8Bwon 2 · lost 1

Decision 4Bwon 2 · lost 1

Wald 4Bwon 2 · lost 1

reflex 4Bwon 2 · lost 1

Verdin 4Bwon 2 · lost 1

Standard One 8B SHwon 2 · lost 1

Qwen3.5-9B Jev-like data-mix v2won 2 · lost 1

Jiwo 4bwon 2 · lost 1

Decision 4B v1.2won 2 · lost 1

Open-Jev 9Bwon 2 · lost 1

Levwon 2 · lost 1

Malkuth 4Bwon 2 · lost 1

Kahn1 4Bwon 2 · lost 1

Pplx Decider Flash V1.2won 2 · lost 1

Metask Jev 4Bwon 2 · lost 1

Decision 2.0 Lux 9Bwon 2 · lost 1

Blink 4Bwon 2 · lost 1

JEB 35B A3Bwon 2 · lost 1

Imajev 4Bwon 2 · lost 1

Jqvwon 2 · lost 1

Imajev 9Bwon 2 · lost 1

Hopperwon 2 · lost 1

janus 4Bwon 2 · lost 1

JevK5 v0.2.0won 2 · lost 1

Seb 9Bwon 2 · lost 1

Clef Flashwon 2 · lost 1

Jebadiah 9B v2.1won 2 · lost 1

deck-4B v1.0won 2 · lost 1

JPT 4Bwon 2 · lost 1

JevK5 v0.3won 2 · lost 1

Shisa De 1won 2 · lost 1

Arcbright Elf 1 12Bwon 2 · lost 1

Metask rain 4Bwon 2 · lost 1

Decider-4b v2won 2 · lost 1

Jev 1.13.0won 1 · lost 1

Plumb 4Bwon 1 · lost 2

Decider 35B A3Bwon 1 · lost 2

Bev / Bonsai 27Bwon 1 · lost 2

LitJevwon 1 · lost 2

Open-Jev 27B v1.1won 1 · lost 2

NInfer Qwen3.8-27Bwon 1 · lost 2

Chon 1.0 E4Bwon 1 · lost 2

Aplomb 1won 1 · lost 2

Hopper 12B trainedwon 1 · lost 2

SPX CD Omniwon 1 · lost 2

Wald 4B v2.1won 1 · lost 2

JevOnewon 1 · lost 2

decisio v0.9.0 on gemma-4-12B-itwon 1 · lost 2

NInfer Qwen3.8-Flash-Next mixedwon 1 · lost 2

Blink v0.3 26B-A4Bwon 1 · lost 2

GEV 26B Decidewon 1 · lost 2

Cygnetwon 1 · lost 2

JPT 35B A3Bwon 1 · lost 2

decisio v0.8.0 on gemma-4-12B-itwon 1 · lost 2

Jev Omniwon 1 · lost 2

AutoJev 27Bwon 1 · lost 2

swanOnewon 1 · lost 2

Surogate Rune 26B-A4B v3won 1 · lost 2

Gemma 4 31Bwon 0 · lost 2

Respan Span-02won 0 · lost 3

Jebadiah 27Bwon 0 · lost 3

decider chat on Gemma-4-31B-itwon 0 · lost 3

Decision 2.0 Vega 27Bwon 0 · lost 3

Winnow-12B Q8won 0 · lost 3

Torchcast Decision 12Bwon 0 · lost 3

decider-12b v1, stock Gemma-4-12B-itwon 0 · lost 3

Decider-12b v2won 0 · lost 3

Xor 26B-A4Bwon 0 · lost 3

Torchcast Decision 4Bwon 0 · lost 3

Bobcat Flash 1.2won 0 · lost 3

RSI-Jev v6.1-VL 27Bwon 0 · lost 3

Nagi-ENORMOUS 27Bwon 0 · lost 3

JEV 27Bwon 0 · lost 3

OpenJevwon 0 · lost 3

H2O-Lightning-4B v1.1won 0 · lost 3

SimpleJev Qwen3.8-27Bwon 0 · lost 3

Clefwon 0 · lost 3

René-1 31Bwon 0 · lost 3

Deck 31Bwon 0 · lost 3

Eikos 27Bwon 0 · lost 3

Metask Jev Rain 12B Trainedwon 0 · lost 3

Metask Jev Rain 31B Trainedwon 0 · lost 3

metask-jev-rain-31B-trained service v3won 0 · lost 3

decisio v0.8.0 on gemma-4-31B-itwon 0 · lost 3

Kev 27Bwon 0 · lost 3

StartLux-Decision v1.1 27B AutoThinkwon 0 · lost 3

Jeff 1.0 Largewon 0 · lost 3

Quyet 1.0 Largewon 0 · lost 3

Torchcast Decision 27Bwon 0 · lost 3

Pplx Decider V1.2won 0 · lost 3

vLLM-SR d3-turbowon 0 · lost 3

Basal Omni 1.0 Ultrawon 0 · lost 3

Perplexity Decider v1.1 27Bwon 0 · lost 3

StartLux-Decision v1.1 27B Instantwon 0 · lost 3

vLLM-SR d3won 0 · lost 3

Chon 1.0 12Bwon 0 · lost 3

§ 3 · Sources

Where the numbers come from

1 publication, 2 figures. Every one links to the page it was read from.

JevBench ↗2 measuresread 2026-10-21

JevBench · Intelligence 56.5%JevBench · Calibration 77%

Badge

[![PublicAI Index](https://publicai.io/model-index/badge?model=bespoke-nimble-9b-v3)](https://publicai.io/model-index/m/bespoke-nimble-9b-v3)