WUMBOLABS / EVALUATIONS MODEL CATALOG / ONE PAGE PER MODEL

/evaluations

Evaluations

Historical and current model-evaluation evidence from WumboLabs hardware. Select a model to see tested profiles, findings, and canonical evidence.

Historical evaluation notice

This catalog includes results produced under earlier WELP methodologies and other testing workflows. WELP v1.0 is scientifically accepted; historical entries have not necessarily been retested under v1.0.

Results remain available as historical evidence. Differences in methodology, hardware, runtime, and configuration should be considered when comparing results. Not every entry was produced by WELP. Protocol revisions do not replace frozen scores or verdicts.

Each tested model has one Evaluation page. Current findings come first; tested profiles and the published testing history follow, with every value attributed to the profile and event that measured it.

The catalog shows one tested artifact per model: the explicitly recommended profile when it has published artifact information, otherwise the newest published profile with that information. Only labeled profiles are recommendations. Select an artifact to see all tested configurations.

Public scientific reports and profile metadata live in WumboLabs/evaluations. Every model page links to its reports at exact commits.

Model evaluations

Model Producer Tested artifact / quantization Latest evidence Evidence
Muse Glimmer 30B Meta Models GGUF · Q4_K_M 2026-11-17 1 event
Nanbeige4.2-3B Nanbeige GGUF · Q8_0 2026-11-17 1 event
Occamy-1.0 Accio Lab GGUF · Q4_K_M 2026-11-17 1 event
Qwen3-Coder-30B-A3B-Instruct Qwen GGUF · Q4_K_M 2026-11-17 1 event
Tess-4.5-27B Migtissera GGUF · Q4_K_M 2026-11-17 1 event
Nanbeige4.3-33B Nanbeige GGUF · Q4_K_M 2026-11-16 1 event
MiMo-V2.6-Distill-Qwen-9B XiaomiMiMo GGUF · Q8_0 2026-11-14 1 event
LFM2.5-8B-A1B Liquid AI Q6_K (official publisher GGUF)
Recommended profile
2026-11-11 4 events
Qwen3.8-Flash-Next Qwen GGUF + native Strata pack · IQ3_S 2026-11-11 1 event
Gemma 4 12B IT Google UD-Q4_K_XL (Unsloth Dynamic 2.0 over QAT Q4_0 lineage)
Recommended profile
2026-11-09 7 events
Qwen3.5-9B Alibaba (Qwen team) Q8_0 weights
Recommended profile
2026-11-08 9 events
Ling 3.0 Tiny inclusionAI (Ant Group) Q8_0 official publisher GGUF
Recommended profile
2026-09-25 4 events
NeoHorse-1-9B TokenRhythm Q8_0 official publisher GGUF
Recommended profile
2026-09-25 3 events
Granite 4.2 8B IBM (ibm-granite) Q4_K_M official publisher GGUF
Recommended profile
2026-09-24 1 event
Spark-X2.5-4B XHToken (SparkLLM Team, iFlytek) Q8_0 (official publisher GGUF, 8.50 BPW)
Recommended profile
2026-09-20 1 event
Ternary Bonsai 2 27B PrismML PTQ1_0 (1.75 bpw ternary group 128, Hadamard-rotated basis)
Recommended profile
2026-09-20 2 events
Mellum2 12B-A2.5B JetBrains Q4_K_M
Recommended profile
2026-09-16 5 events
Qwen3.6-35B-A3B Alibaba (Qwen team) UD-IQ2_M
Recommended profile
2026-09-15 3 events
Qwen3-14B Alibaba (Qwen team) Q4_K_M
Recommended profile
2026-09-14 4 events
Qwen3.8-27B Alibaba (Qwen team) 2.20 bpw EXL3
Recommended profile
2026-09-12 4 events
Nemotron 3 Nano 4B NVIDIA Q4_K_M weights
Recommended profile
2026-09-11 2 events
Qwen3.5-4B Alibaba (Qwen team) BF16 weights
Recommended profile
2026-09-11 1 event
Gemma 4 E4B Google QAT Q4_0 weights, F16 KV cache
Recommended profile
2026-09-10 1 event
MiniCPM5-2B OpenBMB BF16 weights and BF16 KV (primary surface)
Recommended profile
2026-09-10 1 event
Ornith 1.5 9B ornith-ai Q4_K_M
Recommended profile
2026-09-02 2 events
Qwen3.8-4B (Empero) empero-ai (Qwen3.8 derivative) empero-ai/Qwen3.8-4B-Distill-GGUF Q4_K_M
Recommended profile
2026-09-01 2 events
Qwen3.8-9B (Empero) empero-ai (Qwen3.8 derivative) empero-ai/Qwen3.8-9B-Distill-GGUF Q4_K_M / Q5_K_M / Q6_K
Recommended profile
2026-09-01 2 events
LFM2.5 1.2B Liquid AI QAD Q4_0
Recommended profile
2026-08-26 1 event
LFM2.5 2.6B Liquid AI QAD Q4_0
Recommended profile
2026-08-26 1 event
Apodex 1.1 mini Apodex (Qwen3.5-35B-A3B MoE base) IQ1_M
Recommended profile
2026-08-25 1 event
Qwen3.8-2B (Empero) empero-ai (Qwen3.8 derivative) empero-ai/Qwen3.8-2B-GGUF (+ BF16)
Recommended profile
2026-08-18 1 event
Qwen2.5-3B Instruct Alibaba (Qwen team) Qwen/Qwen2.5-3B-Instruct BF16
Recommended profile
2026-07-15 2 events
Bonsai 27B (Q1_0) Upstream identity unresolved (local artifact name) Q1_0
Recommended profile
2026-07-14 1 event
Gemmable 4 12B MTP Mia-AiLab (Gemma 4 12B MTP derivative) Mia-AiLab/Gemmable-4-12B-MTP-GGUF Q4_K_M
Recommended profile
2026-07-04 2 events
Grug 12B kai-os kai-os/Grug-12B-GGUF Q4_K_M
Recommended profile
2026-07-04 2 events