Models

76 open-weight models, sized

Updated 21 Aug 2026 5 new this week, 14 this month

Parameter counts, layer counts and attention shapes are read from each model's own config, because the KV-cache arithmetic depends on them exactly. Sizes below are at Q4_K_M and 8K context against a GeForce RTX 4090. Missing a model that shipped this week? Open an issue — the table is hand-maintained.

AllGeneral assistantCodingReasoning & mathsWritingVisionAgents & tool useTranslationLow latencyLong context
By sizeNewest first
RTX 4090RTX 3060 12 GBRX 7900 XTXM3 Max · 64 GB
ModelReleasedParamsQuantWeightsMax contextLicenceOn this rig
Gemma 4 E4B
The laptop Gemma. 4.5B effective, 8B on disk; a single KV head per window layer keeps its cache tiny.
 2 Apr 2026 8.0B Q4_K_M 4.5 GB 128K Apache 2.0 136 tok/s Check · Hardware
Qwen3 8B
Apache-2.0 alternative to Llama 3.1 8B, with a switchable thinking mode.
 Apr 2025 8.19B Q4_K_M 4.6 GB 128K Apache 2.0 133 tok/s Check · Hardware
Qwen3.5 9B
The default for 8–12 GB cards in 2026: beats every older 8B on every published benchmark, with vision.
 28 Feb 2026 9.65B Q4_K_M 5.4 GB 256K Apache 2.0 112 tok/s Check · Hardware
Gemma 4 12B
The "unified" Gemma 4: text, image and audio in one 12B that fits a 12 GB card at Q4. 140+ languages.
 29 May 2026 12B Q4_K_M 6.7 GB 256K Apache 2.0 90 tok/s Check · Hardware
Gemma 3 12B
Strong multilingual chat with images, sized for 12–16 GB cards. Gemma 4 12B is the same size and better.
 Mar 2025 12.2B Q4_K_M 6.9 GB 128K Gemma Terms of Use 89 tok/s Check · Hardware
Mistral NeMo 12B
Multilingual 12B with a 128K window, built with NVIDIA. A roleplay and fiction favourite that refuses to die.
 Jul 2024 12.2B Q4_K_M 6.9 GB 128K Apache 2.0 89 tok/s Check · Hardware
Qwen3 14B
The largest Qwen3 that fits a 12 GB card at Q4 with room for context.
 Apr 2025 14.8B Q4_K_M 8.3 GB 128K Apache 2.0 73 tok/s Check · Hardware
Gemma 4 26B-A4B
Mixture of experts with 3.8B active. Slower to think than Qwen3.6 35B-A3B, faster to answer, and it sees images.
 2 Apr 2026 26.5B MoE Q4_K_M 14.9 GB 256K Apache 2.0 110 tok/s Check · Hardware
Gemma 3 27B
The 2025 single-GPU generalist with vision. Its Gemma-licence terms are the reason to prefer Gemma 4 now.
 Mar 2025 27.4B Q4_K_M 15.4 GB 128K Gemma Terms of Use 40 tok/s Check · Hardware
Qwen3.8 27B New this week
The current default local Qwen: dense 27B, text + image + video, 262K context. Only 16 of its 64 blocks keep a KV cache, so long context is cheap.
 14 Aug 2026 27.8B Q4_K_M 15.6 GB 256K Apache 2.0 39 tok/s Check · Hardware
Qwen3.6 27B
The 24 GB coding pick of spring 2026 (77.2 SWE-bench Verified). Same shape as 3.8, one generation behind.
 22 Apr 2026 27.8B Q4_K_M 15.6 GB 256K Apache 2.0 39 tok/s Check · Hardware
Gemma 4 31B
The dense flagship: strongest maths of the 24–32 GB class (89% AIME), clean prose, vision. Q4 is a tight 24 GB fit.
 2 Apr 2026 31.3B Q4_K_M 17.6 GB 256K Apache 2.0 35 tok/s Check · Hardware
Qwen3 32B
The classic 24 GB target, and still the strongest local translator under 70B. Qwen3.8 27B is smaller and better at everything else.
 Apr 2025 32.8B Q4_K_M 18.4 GB 128K Apache 2.0 33 tok/s Check · Hardware
LLM-jp 4 33B Thinking New this week
Japan’s national-institute reasoning model, Japanese and English. A plain dense Llama-style 33B: Q4 is a tight 24 GB fit.
 14 Aug 2026 33.2B Q4_K_M 18.7 GB 64K Apache 2.0 33 tok/s Check · Hardware

Weight sizes are computed from the parameter count and the quantisation's effective bits per weight, not read off a file listing — expect them to land within a few percent of the GGUF you actually download. The method, in full.