Request a Pilot
‹ PublicAI Index

The LLM benchmark aggregator.

H2O-Lightning-31B v1.0.7

Other · 31B

Strongest in Routing & classification (#1 of 234), weakest in Calibration (#42 of 234). Above par in 3 of 3 scopes. Among the models it meets almost everywhere, it finishes behind Baselabs mammoth-1 and KnowLine 31B-Gen1 and ahead of StartLux-Decision v1.1 27B Instant and vLLM-SR d3-turbo.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Decisions64.9#4/234
Routing & classification71.7#1/234
Calibration58.1#42/234

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for H2O-Lightning-31B v1.0.7, left for the other.

JevK5 v0.2.0won 2 · lost 0
KnowLine 26B-A4B-Gen2.5won 2 · lost 0
CLM 8Bwon 3 · lost 0
Laya multilingualwon 3 · lost 0
Julia 1won 3 · lost 0
Tacet Sonatawon 3 · lost 0
Raw Qwen3 1.7B direct logitswon 3 · lost 0
Raw Qwen3 0.6B direct logitswon 3 · lost 0
ClassOne Qwen 3.5 2Bwon 3 · lost 0
Deem 0.8B v1won 3 · lost 0
Mirrorwon 3 · lost 0
ClassOne Gemma 4 E2Bwon 3 · lost 0
openJev Verdictwon 3 · lost 0
SimpleJevwon 3 · lost 0
Phocinae Largha 150M V1won 3 · lost 0
Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads)won 3 · lost 0
Quyet 1.0 Smallwon 3 · lost 0
Layawon 3 · lost 0
kev 0.5Bwon 3 · lost 0
Liquid AI d1-omni-600Mwon 3 · lost 0
Vega 0.8Bwon 3 · lost 0
Raw Qwen3 8B direct logitswon 3 · lost 0
Raw Phi-4 mini direct logitswon 3 · lost 0
System Onewon 3 · lost 0
ClassOne Qwen 3.5 4Bwon 3 · lost 0
Vega 4Bwon 3 · lost 0
ClassOne Gemma 4 E4Bwon 3 · lost 0
WaterSheepwon 3 · lost 0
Open Jev Deberta V3 Largewon 3 · lost 0
Raw Qwen3 4B Instruct direct logitswon 3 · lost 0
kev 0.6Bwon 3 · lost 0
OpenDecisionwon 3 · lost 0
Verdict Smallwon 3 · lost 0
Quyet 1.0 Small ENwon 3 · lost 0
Chon 1.0 12Bwon 3 · lost 0
Krino 2Bwon 3 · lost 0
openJev Verdict 1.4won 3 · lost 0
Decision Fastwon 3 · lost 0
Jeetu Decider 2Bwon 3 · lost 0
Decisor 4Bwon 3 · lost 0
Gutsy 0.8B v0.3won 3 · lost 0
Watt Flash 0.1won 3 · lost 0
kev 4Bwon 3 · lost 0
Vega Uwon 3 · lost 0
Jul fastwon 3 · lost 0
Alibaba GTE Reranker ModernBERT-basewon 3 · lost 0
Smalljev semantic-v9won 3 · lost 0
Decider 2Bwon 3 · lost 0
PurpleMIST Mini 1.0won 3 · lost 0
Qwen3 Reranker 4Bwon 3 · lost 0
Jez Small 1.0.0won 3 · lost 0
Lev 350Mwon 3 · lost 0
JADEwon 3 · lost 0
Certo v1won 3 · lost 0
Laya typed-decisionswon 3 · lost 0
Mixedbread mxbai-rerank-base-v2won 3 · lost 0
BAAI bge-reranker-v2-m3won 3 · lost 0
D1A on Gemma 4 E2Bwon 3 · lost 0
Nemotron Diffusion 8Bwon 3 · lost 0
ClassOne Qwen 3.5 9Bwon 3 · lost 0
Open-Jev 2Bwon 3 · lost 0
Jiwo 0.8bwon 3 · lost 0
Open Jev JSON Canvaswon 3 · lost 0
DecisionNode Edge Mini 0.9.2won 3 · lost 0
OpenSourceJevwon 3 · lost 0
Malkuth 2Bwon 3 · lost 0
EXAONE-4.0-1.2B-JEV v0.3won 3 · lost 0
kev 8Bwon 3 · lost 0
Open Alternative Jevwon 3 · lost 0
Liquid AI d1-3Bwon 3 · lost 0
ZeroEntropy zerank-2won 3 · lost 0
Spark S1 4B V6won 3 · lost 0
D1A on Gemma 4 E4Bwon 3 · lost 0
DecisionNode Edge 0.9.2won 3 · lost 0
Arbiter 4Bwon 3 · lost 0
RYOTIDE Qwen9won 3 · lost 0
APUS OpenJev V1 9Bwon 3 · lost 0
Diffusion Jevwon 3 · lost 0
Bespoke Nimble 9Bwon 3 · lost 0
Jez Large 1.0.0won 3 · lost 0
Nomawon 3 · lost 0
Imajev 2Bwon 3 · lost 0
Standard One 3B SHwon 3 · lost 0
ArseneLupin v1.1won 3 · lost 0
Standard One 3B SH v4won 3 · lost 0
TypeCastLM 1.4.0won 3 · lost 0
SemIfwon 3 · lost 0
local-jev Qwen3.5-4Bwon 3 · lost 0
Decision 2Bwon 3 · lost 0
Jev Localwon 3 · lost 0
Compass 0.2.0won 3 · lost 0
Messier One v0.2won 3 · lost 0
Uniphore 4B Deciderwon 3 · lost 0
Typecastlmwon 3 · lost 0
CoCo Decision 4Bwon 3 · lost 0
Pjev 2Bwon 3 · lost 0
Jebadiah 9B v2won 3 · lost 0
RYOTIDE Qwenwon 3 · lost 0
Iota Decide 4Bwon 3 · lost 0
JEV Qwen3.5-9B Basewon 3 · lost 0
Decider 4Bwon 3 · lost 0
Decision 4B v1.1won 3 · lost 0
Quyet 1.0won 3 · lost 0
Clef Omniwon 3 · lost 0
Manchego v2.1won 3 · lost 0
Standard One 8Bwon 3 · lost 0
Decision 4Bwon 3 · lost 0
Wald 4Bwon 3 · lost 0
reflex 4Bwon 3 · lost 0
Verdin 4Bwon 3 · lost 0
Qwen3.5-9B Jev-like data-mix v2won 3 · lost 0
Standard One 8B SHwon 3 · lost 0
Messier One v0.4won 3 · lost 0
Jiwo 4bwon 3 · lost 0
Pplx Decider Flash V1.2won 3 · lost 0
Open-Jev 9Bwon 3 · lost 0
Decision 4B v1.2won 3 · lost 0
Levwon 3 · lost 0
Kahn1 4Bwon 3 · lost 0
Metask Jev 4Bwon 3 · lost 0
Malkuth 4Bwon 3 · lost 0
Hopperwon 3 · lost 0
Blink 4Bwon 3 · lost 0
Decision 2.0 Lux 9Bwon 3 · lost 0
Decisio v0.9.0 on Qwen3.6-35B-A3Bwon 3 · lost 0
Imajev 4Bwon 3 · lost 0
Imajev 9Bwon 3 · lost 0
janus 4Bwon 3 · lost 0
GLiClass v4 9Bwon 3 · lost 0
Seb 9Bwon 3 · lost 0
Clef Flashwon 3 · lost 0
JPT 4Bwon 3 · lost 0
deck-4B v1.0won 3 · lost 0
Seb 9B V2won 3 · lost 0
Jeffan 4Bwon 3 · lost 0
Shisa De 1won 3 · lost 0
Arcbright Elf 1 12Bwon 3 · lost 0
Metask rain 4Bwon 3 · lost 0
Bespoke Nimble 9B v3won 3 · lost 0
Plumb 4Bwon 3 · lost 0
Decider 35B A3Bwon 3 · lost 0
KnowLine 4B-Gen5.5won 3 · lost 0
Bev / Bonsai 27Bwon 3 · lost 0
Amazon Strands Decider 26B-A4Bwon 3 · lost 0
Tern 35B A3Bwon 3 · lost 0
Open-Jev 27B v1.1won 3 · lost 0
Aplomb 1won 3 · lost 0
Chon 1.0 E4Bwon 3 · lost 0
NInfer Qwen3.8-27Bwon 3 · lost 0
Respan Span-02won 3 · lost 0
Hopper 12B trainedwon 3 · lost 0
Torchcast Decision 4B v1.1won 3 · lost 0
Iota Decide 4B V0.3won 3 · lost 0
Xevn 4Bwon 3 · lost 0
SPX CD Omniwon 3 · lost 0
Philly Decider v2won 3 · lost 0
Chon 1.0 12B Fastwon 3 · lost 0
vLLM-SR d3-miniwon 3 · lost 0
Wald 4B v2.1won 3 · lost 0
Jebadiah 27Bwon 3 · lost 0
decider chat on Gemma-4-31B-itwon 3 · lost 0
Baselabs elephant-1won 3 · lost 0
decisio v0.9.0 on gemma-4-12B-itwon 3 · lost 0
Decider-12b v2won 3 · lost 0
decider-12b v1, stock Gemma-4-12B-itwon 3 · lost 0
Decision 2.0 Vega 27Bwon 3 · lost 0
Winnow-12B Q8won 3 · lost 0
Xor 26B-A4Bwon 3 · lost 0
Cygnetwon 3 · lost 0
Torchcast Decision 12Bwon 3 · lost 0
decisio v0.8.0 on gemma-4-12B-itwon 3 · lost 0
Jev Omniwon 3 · lost 0
AutoJev 27Bwon 3 · lost 0
Bobcat Flash 1.2won 3 · lost 0
Torchcast Decision 4B v1.2won 3 · lost 0
FrontiersMind Lumma-fev-27Bwon 3 · lost 0
swanOnewon 3 · lost 0
RSI-Jev v6.1-VL 27Bwon 3 · lost 0
Nagi-ENORMOUS 27Bwon 3 · lost 0
OpenJevwon 3 · lost 0
Decisio 12B tuned commitwon 3 · lost 0
Aleria Judge 1.1.1won 3 · lost 0
Deck 31Bwon 3 · lost 0
Metask Jev Rain 12B Trainedwon 3 · lost 0
Wald 26B-A4Bwon 3 · lost 0
Torchcast Decision 4B v1.3won 3 · lost 0
Bobcat 1.3won 3 · lost 0
Metask Jev Rain 31B Trainedwon 3 · lost 0
metask-jev-rain-31B-trained service v3won 3 · lost 0
Lychee 27Bwon 3 · lost 0
decisio v0.8.0 on gemma-4-31B-itwon 3 · lost 0
Jeff 1.1won 3 · lost 0
JEB 35B A3Bwon 2 · lost 1
Jqvwon 2 · lost 1
Jebadiah 9B v2.1won 2 · lost 1
JevK5 v0.3won 2 · lost 1
Decider-4b v2won 2 · lost 1
LitJevwon 2 · lost 1
JevOnewon 2 · lost 1
NInfer Qwen3.8-Flash-Next mixedwon 2 · lost 1
Blink v0.3 26B-A4Bwon 2 · lost 1
GEV 26B Decidewon 2 · lost 1
JPT 35B A3Bwon 2 · lost 1
Surogate Rune 26B-A4B v3won 2 · lost 1
JEV 27Bwon 2 · lost 1
H2O-Lightning-4B v1.1won 2 · lost 1
SimpleJev Qwen3.8-27Bwon 2 · lost 1
Clefwon 2 · lost 1
René-1 31Bwon 2 · lost 1
Eikos 27Bwon 2 · lost 1
KnowLine 35B-A3B-Gen1.5won 2 · lost 1
StartLux-Decision v1.1 27B AutoThinkwon 2 · lost 1
Kev 27Bwon 2 · lost 1
Vera Largewon 2 · lost 1
Torchcast Decision 27Bwon 2 · lost 1
Pplx Decider V1.2won 2 · lost 1
Turion Jev 31Bwon 2 · lost 1
Nimble V4won 2 · lost 1
AJev lm6qwon 2 · lost 1
Sieve 31B V2won 2 · lost 1
Quyet 1.0 Largewon 2 · lost 1
Jeff 1.0 Largewon 2 · lost 1
Jeffan 31Bwon 2 · lost 1
Arcbright Elf 1 31Bwon 2 · lost 1
DOPEST 1.0 31Bwon 2 · lost 1
Basal Omni 1.0 Ultrawon 2 · lost 1
vLLM-SR d3won 2 · lost 1
Perplexity Decider v1.1 27Bwon 2 · lost 1
vLLM-SR d3-turbowon 2 · lost 1
StartLux-Decision v1.1 27B Instantwon 2 · lost 1
Fastino GLiDE 1.2won 1 · lost 2
KnowLine 31B-Gen1won 1 · lost 2
Baselabs mammoth-1won 1 · lost 2

§ 3 · Sources

Where the numbers come from

1 publication, 2 figures. Every one links to the page it was read from.

JevBench ↗2 measuresread 2026-11-10
JevBench · Intelligence 79.3%JevBench · Calibration 89.4%

Badge

PublicAI Index badge for H2O-Lightning-31B v1.0.7[![PublicAI Index](https://publicai.io/model-index/badge?model=h2o-lightning-31b-v1-0-7)](https://publicai.io/model-index/m/h2o-lightning-31b-v1-0-7)