Request a pilot
‹ PublicAI Index

The LLM benchmark aggregator.

OpenJev

Other

Strongest in Routing & classification (#6 of 85), weakest in Calibration (#59 of 85). Above par in 2 of 3 scopes. Among the models it meets almost everywhere, it finishes behind DeepSeek V4.1 Flash and GPT-6 Luna and ahead of Gemini 3.1 Flash Lite and JEV Qwen3.5-9B Base NVFP4.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Decisions55#24/85
Routing & classification62.5#6/85
Calibration47.5#59/85

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for OpenJev, left for the other.

Laya 322Mwon 2 · lost 0
Djev Sparkwon 2 · lost 0
Mirrorwon 3 · lost 0
Raw Qwen3 0.6B direct logitswon 3 · lost 0
GLiNER2won 3 · lost 0
GLiNER2 largewon 3 · lost 0
Raw Qwen3 1.7B direct logitswon 3 · lost 0
CLM 8Bwon 3 · lost 0
SimpleJevwon 3 · lost 0
GLiNER2.5 smallwon 3 · lost 0
Raw Qwen3 8B direct logitswon 3 · lost 0
Open Jev JSON Canvaswon 3 · lost 0
openJev Verdictwon 3 · lost 0
Raw Qwen3 4B Instruct direct logitswon 3 · lost 0
System Onewon 3 · lost 0
GLiNER2.5 multiwon 3 · lost 0
kev 0.5Bwon 3 · lost 0
Decider 2Bwon 3 · lost 0
kev 4Bwon 3 · lost 0
kev 8Bwon 3 · lost 0
JevActwon 3 · lost 0
kev 0.6Bwon 3 · lost 0
OpenDecisionwon 3 · lost 0
Spark S1 4B V6won 3 · lost 0
Malkuth 2Bwon 3 · lost 0
Open-Jev 2Bwon 3 · lost 0
System One Openwon 3 · lost 0
Bespoke Nimble 9Bwon 3 · lost 0
Verdict Smallwon 2 · lost 1
Smalljev semantic-v9won 2 · lost 1
Alibaba GTE Reranker ModernBERT-basewon 2 · lost 1
Certo v1won 2 · lost 1
Mixedbread mxbai-rerank-base-v2won 2 · lost 1
BAAI bge-reranker-v2-m3won 2 · lost 1
Open Jev Deberta V3 Largewon 2 · lost 1
Qwen3.5-0.8B Decision Modelwon 2 · lost 1
Typecastlmwon 2 · lost 1
Open Alternative Jevwon 2 · lost 1
Layawon 2 · lost 1
openJev Verdict 1.4won 2 · lost 1
Raw Phi-4 mini direct logitswon 2 · lost 1
Decision Fastwon 2 · lost 1
OpenSourceJevwon 2 · lost 1
Jeffwon 2 · lost 1
Malkuth 4Bwon 2 · lost 1
Lev 350Mwon 2 · lost 1
SimpleJev Qwen3.6-35B-A3Bwon 2 · lost 1
Open-Jev 9Bwon 2 · lost 1
Qwen3.5-9B Jev-like data-mix v2won 2 · lost 1
Vonwon 2 · lost 1
Decision Machine 1won 2 · lost 1
Jev Localwon 2 · lost 1
Qwen3 Reranker 4Bwon 2 · lost 1
Jobe Qwen3.5-4Bwon 2 · lost 1
Jev Omniwon 2 · lost 1
SemIfwon 2 · lost 1
Metask Jev 4Bwon 2 · lost 1
Standard One 8Bwon 2 · lost 1
Decision 2Bwon 2 · lost 1
Decider 35B A3Bwon 2 · lost 1
Winnow-12B Q8won 2 · lost 1
JEV Qwen3.5-9B Base NVFP4won 2 · lost 1
Gemini 3.1 Flash Litewon 2 · lost 1
ZeroEntropy zerank-2won 1 · lost 2
local-jev Qwen3.5-4Bwon 1 · lost 2
Jqvwon 1 · lost 2
reflex 4Bwon 1 · lost 2
Openjev Sglangwon 1 · lost 2
LitJevwon 1 · lost 2
Reflex 27Bwon 1 · lost 2
JevK5 v0.2.0won 1 · lost 2
swanOnewon 1 · lost 2
Decider-4b v2won 1 · lost 2
Cygnetwon 1 · lost 2
JevOnewon 1 · lost 2
SimpleJev Qwen3.8-27Bwon 1 · lost 2
Hopperwon 1 · lost 2
NInfer Qwen3.8-27B NVFP4won 1 · lost 2
NInfer Qwen3.8-Flash-Next mixedwon 1 · lost 2
Jev 1.13.0won 1 · lost 2
Instinctwon 1 · lost 2
Gemma 4 31Bwon 0 · lost 2
Gemma 4 31B IT (Autoloops)won 0 · lost 3
Djevwon 0 · lost 3
GPT-5.6 Lunawon 0 · lost 3
GPT-6 Lunawon 0 · lost 3
DeepSeek V4.1 Flashwon 0 · lost 3

§ 3 · Sources

Where the numbers come from

1 publication, 2 figures. Every one links to the page it was read from.

JevBench ↗2 measuresread 2026-09-26
JevBench · Intelligence 58.1%JevBench · Calibration 58.1%

Badge

PublicAI Index badge for OpenJev[![PublicAI Index](https://publicai.io/model-index/badge?model=openjev)](https://publicai.io/model-index/m/openjev)