/evaluations
Evaluations
Historical and current model-evaluation evidence from WumboLabs hardware. Select a model to see tested profiles, findings, and canonical evidence.
Historical evaluation notice
This catalog includes results produced under earlier WELP methodologies and other testing workflows. WELP v1.0 is scientifically accepted; historical entries have not necessarily been retested under v1.0.
Results remain available as historical evidence. Differences in methodology, hardware, runtime, and configuration should be considered when comparing results. Not every entry was produced by WELP. Protocol revisions do not replace frozen scores or verdicts.
Each tested model has one Evaluation page. Current findings come first; tested profiles and the published testing history follow, with every value attributed to the profile and event that measured it.
The catalog shows one tested artifact per model: the explicitly recommended profile when it has published artifact information, otherwise the newest published profile with that information. Only labeled profiles are recommendations. Select an artifact to see all tested configurations.
Public scientific reports and profile metadata live in WumboLabs/evaluations. Every model page links to its reports at exact commits.
Model evaluations
All evaluations are shown.
| Model | Producer | Tested artifact / quantization | Latest evidence | Evidence |
|---|---|---|---|---|
| Muse Glimmer 30B | Meta Models | GGUF · Q4_K_M | 2026-11-17 | 1 event |
| Nanbeige4.2-3B | Nanbeige | GGUF · Q8_0 | 2026-11-17 | 1 event |
| Occamy-1.0 | Accio Lab | GGUF · Q4_K_M | 2026-11-17 | 1 event |
| Qwen3-Coder-30B-A3B-Instruct | Qwen | GGUF · Q4_K_M | 2026-11-17 | 1 event |
| Tess-4.5-27B | Migtissera | GGUF · Q4_K_M | 2026-11-17 | 1 event |
| Nanbeige4.3-33B | Nanbeige | GGUF · Q4_K_M | 2026-11-16 | 1 event |
| MiMo-V2.6-Distill-Qwen-9B | XiaomiMiMo | GGUF · Q8_0 | 2026-11-14 | 1 event |
| LFM2.5-8B-A1B | Liquid AI | Q6_K (official publisher GGUF) Recommended profile |
2026-11-11 | 4 events |
| Qwen3.8-Flash-Next | Qwen | GGUF + native Strata pack · IQ3_S | 2026-11-11 | 1 event |
| Gemma 4 12B IT | UD-Q4_K_XL (Unsloth Dynamic 2.0 over QAT Q4_0 lineage) Recommended profile |
2026-11-09 | 7 events | |
| Qwen3.5-9B | Alibaba (Qwen team) | Q8_0 weights Recommended profile |
2026-11-08 | 9 events |
| Ling 3.0 Tiny | inclusionAI (Ant Group) | Q8_0 official publisher GGUF Recommended profile |
2026-09-25 | 4 events |
| NeoHorse-1-9B | TokenRhythm | Q8_0 official publisher GGUF Recommended profile |
2026-09-25 | 3 events |
| Granite 4.2 8B | IBM (ibm-granite) | Q4_K_M official publisher GGUF Recommended profile |
2026-09-24 | 1 event |
| Spark-X2.5-4B | XHToken (SparkLLM Team, iFlytek) | Q8_0 (official publisher GGUF, 8.50 BPW) Recommended profile |
2026-09-20 | 1 event |
| Ternary Bonsai 2 27B | PrismML | PTQ1_0 (1.75 bpw ternary group 128, Hadamard-rotated basis) Recommended profile |
2026-09-20 | 2 events |
| Mellum2 12B-A2.5B | JetBrains | Q4_K_M Recommended profile |
2026-09-16 | 5 events |
| Qwen3.6-35B-A3B | Alibaba (Qwen team) | UD-IQ2_M Recommended profile |
2026-09-15 | 3 events |
| Qwen3-14B | Alibaba (Qwen team) | Q4_K_M Recommended profile |
2026-09-14 | 4 events |
| Qwen3.8-27B | Alibaba (Qwen team) | 2.20 bpw EXL3 Recommended profile |
2026-09-12 | 4 events |
| Nemotron 3 Nano 4B | NVIDIA | Q4_K_M weights Recommended profile |
2026-09-11 | 2 events |
| Qwen3.5-4B | Alibaba (Qwen team) | BF16 weights Recommended profile |
2026-09-11 | 1 event |
| Gemma 4 E4B | QAT Q4_0 weights, F16 KV cache Recommended profile |
2026-09-10 | 1 event | |
| MiniCPM5-2B | OpenBMB | BF16 weights and BF16 KV (primary surface) Recommended profile |
2026-09-10 | 1 event |
| Ornith 1.5 9B | ornith-ai | Q4_K_M Recommended profile |
2026-09-02 | 2 events |
| Qwen3.8-4B (Empero) | empero-ai (Qwen3.8 derivative) | empero-ai/Qwen3.8-4B-Distill-GGUF Q4_K_M Recommended profile |
2026-09-01 | 2 events |
| Qwen3.8-9B (Empero) | empero-ai (Qwen3.8 derivative) | empero-ai/Qwen3.8-9B-Distill-GGUF Q4_K_M / Q5_K_M / Q6_K Recommended profile |
2026-09-01 | 2 events |
| LFM2.5 1.2B | Liquid AI | QAD Q4_0 Recommended profile |
2026-08-26 | 1 event |
| LFM2.5 2.6B | Liquid AI | QAD Q4_0 Recommended profile |
2026-08-26 | 1 event |
| Apodex 1.1 mini | Apodex (Qwen3.5-35B-A3B MoE base) | IQ1_M Recommended profile |
2026-08-25 | 1 event |
| Qwen3.8-2B (Empero) | empero-ai (Qwen3.8 derivative) | empero-ai/Qwen3.8-2B-GGUF (+ BF16) Recommended profile |
2026-08-18 | 1 event |
| Qwen2.5-3B Instruct | Alibaba (Qwen team) | Qwen/Qwen2.5-3B-Instruct BF16 Recommended profile |
2026-07-15 | 2 events |
| Bonsai 27B (Q1_0) | Upstream identity unresolved (local artifact name) | Q1_0 Recommended profile |
2026-07-14 | 1 event |
| Gemmable 4 12B MTP | Mia-AiLab (Gemma 4 12B MTP derivative) | Mia-AiLab/Gemmable-4-12B-MTP-GGUF Q4_K_M Recommended profile |
2026-07-04 | 2 events |
| Grug 12B | kai-os | kai-os/Grug-12B-GGUF Q4_K_M Recommended profile |
2026-07-04 | 2 events |
No evaluations match this search.