/evaluations/gemmable-4-12b
Gemmable 4 12B MTP
Published evaluation evidence and testing history. Results remain attributed to their original configurations and methods.
latest evidence 2026-07-04
Overview
Mia-AiLab (Gemma 4 12B MTP derivative) · 1 tested configuration · 2 evidence events · newest evidence 2026-07-04.
Contents: Findings · Event results · Tested configurations · Chronology · Technical provenance
Findings
Each finding is attributed to the event and tested configuration that measured it; exact values, failures and limitations are in the event results. A historical event's recorded status describes that event's own sections at its date and is not a verdict on newer sections.
- Recommended configuration: llama.cpp Q4_K_M (current): event result.
- Latest evidence: 2026-07-04: event result
- 2026-07-04 · llama.cpp · RTX 5070: classification BENCHMARK_ONLY (LMX local speed). Event result
- 2026-06-21 · llama.cpp · RTX 5070: classification SPECIALIZED_TEST. Event result
Event results
Newest first. Each event is one independent testing/publication event with its full report linked once at the top of its section; scores, failures and limitations stay visible and raw section-provenance JSON stays collapsed.
2026-07-04: LMX speed run
Benchmark Only: LMX local speed · config llama.cpp · RTX 5070 · maturity: BENCHMARK_ONLY · status: BENCHMARK_ONLY (LMX local speed)
Configuration: llama.cpp Q4_K_M.
LMX local speed evidence: 71.24 tok/s out (llama.cpp Q4_K_M).
This event is a bounded public-safe summary derived from retained WumboLabs evidence. It is not a WELP characterization, a universal model ranking, or a production-readiness proof. Values are attributed to the tested artifact, runtime, hardware, suite, and settings.
Identity and scope
- Profile:
gemmable-4-12b-llamacpp-q4km: llama.cpp Q4_K_M - Evidence maturity: BENCHMARK_ONLY
- Evidence scope: performance
- Hardware: WumboJetsII (RTX 5070 12GB)
2026-06-21: Agent-backend + fake-tool runs
Specialized Test: agent backend · config llama.cpp · RTX 5070 · maturity: SPECIALIZED_TEST · status: SPECIALIZED_TEST
Configuration: llama.cpp Q4_K_M.
Agent-backend-v1 and fake-tool answer-only probes for the Gemmable MTP artifact.
This event is a bounded public-safe summary derived from retained WumboLabs evidence. It is not a WELP characterization, a universal model ranking, or a production-readiness proof. Values are attributed to the tested artifact, runtime, hardware, suite, and settings.
Identity and scope
- Profile:
gemmable-4-12b-llamacpp-q4km: llama.cpp Q4_K_M - Evidence maturity: SPECIALIZED_TEST
- Evidence scope: specialized, agent-backend
- Hardware: WumboJetsII (RTX 5070 12GB)
Tested configurations
Exact profile identities, sampling conditions and provenance are in each configuration's details below.
| Configuration | Artifact / precision | Runtime | Hardware | Context / reasoning | Events |
|---|---|---|---|---|---|
| llama.cpp · RTX 5070 | Mia-AiLab/Gemmable-4-12B-MTP-GGUF Q4_K_M | llama.cpp | RTX 5070 | not recorded | 2 (2026-06-21, 2026-07-04) |
Configuration details: llama.cpp · RTX 5070
- Full profile name: llama.cpp Q4_K_M.
- Profile identity:
gemmable-4-12b-llamacpp-q4km. - Status: current canonical/recommended tested surface.
- Artifact (as recorded): Mia-AiLab/Gemmable-4-12B-MTP-GGUF Q4_K_M
- Runtime (as recorded): llama.cpp.
- Profile Metadata
Events on this configuration:
- LMX speed run (2026-07-04); status: BENCHMARK_ONLY (LMX local speed)
- Agent-backend + fake-tool runs (2026-06-21); status: SPECIALIZED_TEST
Chronology
Compact index; full results are in Event results.
| Date | Event | Configuration | Status |
|---|---|---|---|
| 2026-07-04 | LMX speed run | llama.cpp · RTX 5070 | BENCHMARK_ONLY (LMX local speed) |
| 2026-06-21 | Agent-backend + fake-tool runs | llama.cpp · RTX 5070 | SPECIALIZED_TEST |
Technical provenance
Publication, acceptance and source-pin provenance for each event, collapsed; the scientific content above never depends on it.
Legacy provenance
- WumboLabs/eval-gemmable-4-12b @
f307603ad9e1515ff59261d86f842e1cace43980 - WumboLabs/eval-gemmable-4-12b @
f307603ad9e1515ff59261d86f842e1cace43980
Shared comparison events
This model appears in shared multi-model comparisons. Each report is stored once in WumboLabs/evaluations/shared-events/; the model's measured entries remain attributed to the same historical event:
- 12B Gemma practical-use test (QAT vs UD-Q5 vs Gemmable) (2026-06-21): Gemmable 4 12B MTP Q4_K_M scored 119.8/300 (2.0 avg) on the same suite Canonical evidence / full report