Models

76 open-weight models, sized

Updated 21 Aug 2026 5 new this week, 14 this month

Parameter counts, layer counts and attention shapes are read from each model's own config, because the KV-cache arithmetic depends on them exactly. Sizes below are at Q4_K_M and 8K context against a GeForce RTX 3060 12 GB. Missing a model that shipped this week? Open an issue — the table is hand-maintained.

AllGeneral assistantCodingReasoning & mathsWritingVisionAgents & tool useTranslationLow latencyLong context
By sizeNewest first
RTX 4090RTX 3060 12 GBRX 7900 XTXM3 Max · 64 GB
ModelReleasedParamsQuantWeightsMax contextLicenceOn this rig
Qwen3.8 27B New this week
The current default local Qwen: dense 27B, text + image + video, 262K context. Only 16 of its 64 blocks keep a KV cache, so long context is cheap.
 14 Aug 2026 27.8B Q4_K_M 15.6 GB 256K Apache 2.0 offload Check · Hardware
Qwen3.6 27B
The 24 GB coding pick of spring 2026 (77.2 SWE-bench Verified). Same shape as 3.8, one generation behind.
 22 Apr 2026 27.8B Q4_K_M 15.6 GB 256K Apache 2.0 offload Check · Hardware
Gemma 4 31B
The dense flagship: strongest maths of the 24–32 GB class (89% AIME), clean prose, vision. Q4 is a tight 24 GB fit.
 2 Apr 2026 31.3B Q4_K_M 17.6 GB 256K Apache 2.0 offload Check · Hardware
Qwen3.6 35B-A3B
Mixture of experts with ~3B active: the fastest serious model a 24 GB card runs, and the best MoE under 40B on agentic coding.
 16 Apr 2026 35.9B MoE Q4_K_M 20.2 GB 256K Apache 2.0 offload Check · Hardware
Llama 4 Scout 109B-A17B
A 10M-token window on paper, chunked attention in practice (8K chunks on 3 of 4 layers). Needs 64 GB+ at Q4.
 5 Apr 2025 109B MoE Q4_K_M 61.3 GB 1024K Llama 4 Community won't fit Check · Hardware
Ling 3.0 Flash 124B-A5B New
A 124B hybrid (5 linear-attention layers per MLA layer) with 5.1B active: SWE-bench Pro 56.6 and AIME 93 claimed. Built for 96–128 GB machines.
 2 Aug 2026 124B MoE Q4_K_M 69.7 GB 256K MIT won't fit Check · Hardware
Qwen3.5 122B-A10B
The 96–128 GB unified-memory model: 122B of knowledge at 10B-active speed.
 24 Feb 2026 125B MoE Q4_K_M 70.3 GB 256K Apache 2.0 won't fit Check · Hardware
DeepSeek V4 Flash 284B-A13B New
The V4 that 128 GB machines can actually run at Q3. Cache is modelled as a 576-wide latent; V4 compresses it further at long context, so this is conservative.
 31 Jul 2026 284B MoE Q4_K_M 159.7 GB 1024K MIT won't fit Check · Hardware

Weight sizes are computed from the parameter count and the quantisation's effective bits per weight, not read off a file listing — expect them to land within a few percent of the GGUF you actually download. The method, in full.