No — not on this device

DeepSeek V4.1 Flash 552B-A16B at Q4_K_M needs 311.0 GB against 10.7 GB usable, and the shortfall of 300.3 GB is more than 128 GB of system RAM can cover at a tolerable speed. A smaller sibling or a lower quantisation is the honest answer here.

Does not fit 8K context Q4_K_M · 310.4 GB MIT Released 10 Sep 2026 New this month Vision Not in the Ollama library

Twice V4 Flash's backbone (552B, 16B active per generated token) plus 196B of Engram lookup tables (189 GiB at FP8) that DwarfStar streams from SSD, so they are not counted here. A 512 GB Mac model, and as of October 2026 no mainline llama.cpp or Ollama build: DwarfStar on a Mac, vLLM across four GPUs. DeepSeek puts the cache at 890 bytes/token; modelled conservatively as 4 latent layers plus a 128-token window.

Hardware requirements What hardware do I need to run DeepSeek V4.1 Flash 552B-A16B? →

At Q4_K_M with an 8K context: a 512 GB Mac (M3 Ultra). Minimum, recommended, high-quality and long-context tiers, with all 114 devices checked at every quantisation.

The VRAM budget

weights 310.4 GB
Weights 310.4 GB KV cache @ 8K 0.04 GB Runtime overhead 0.6 GB Over budget 300.3 GB past 10.7 GB

Quantisation ladder

QuantWeightsTotal @ 8KMax contextTok/sQualityFit
Q8_0 546.2 GB 546.9 GB — ~2.0 −0.1% ppl 536.2 GB over
Q6_K 421.6 GB 422.2 GB — ~2.6 −0.4% ppl 411.5 GB over
Q5_K_M 364.4 GB 365.0 GB — ~3.0 −0.8% ppl 354.3 GB over
Q4_K_M 310.4 GB 311.0 GB — ~3.5 −1.9% ppl 300.3 GB over
Q3_K_M 251.3 GB 251.9 GB — ~4.3 −5.4% ppl 241.2 GB over
Q2_K 215.3 GB 215.9 GB — ~5.0 −15% ppl 205.2 GB over

Quality is the published perplexity delta against f16 weights. Max context assumes an f16 KV cache; q8_0 roughly doubles it. This model interleaves sliding-window layers (128 tokens, 4 of 40 layers global), which is why its cache barely grows with context. This model uses multi-head latent attention, so its cache is a compressed latent rather than full K and V.

How to run it

terminal
# in a DwarfStar checkout on the ds4.1flash branch
$ ./download_model.sh ds41f-q4
$ ./ds4 -m gguf/DeepSeek-V4.1-Flash-Q4.gguf --ctx 8192

On a Mac with less than 512 GB, download ds41f-q2 instead and add --ssd-streaming.

antirez's Metal inference engine for DeepSeek V4, with V4.1 support on its ds4.1flash branch. More on DwarfStar.

01The Q4 file is 483 GiB: 294 GiB of weights plus 189 GiB of Engram tables that stay on the SSD and are read row by row. Allow another 37 GiB while the downloader joins its two parts.
02macOS caps what the GPU may wire down at about 10.7 GB of 16 GB. Raising it with iogpu.wired_limit_mb is possible, and risky.
03If it falls back to CPU silently, drop the context first, then step down a quantisation.
See all models for this rig Compare with another model

Related models on an M4 · 16 GB

ModelTotalTok/s est.
DeepSeek V4 Flash 284B-A13B
284B MoE · same family
Q4_K_M · 160.7 GB — Won't fit
DeepSeek V4 Pro 1.6T-A49B
1650B MoE · same family
Q4_K_M · 928.9 GB — Won't fit
DeepSeek-R1 671B
671B MoE · similar size
Q4_K_M · 378.4 GB — Won't fit
GLM-5.2 744B-A40B
753B MoE · similar size
Q4_K_M · 424.7 GB — Won't fit
GLM-5.3 744B-A40B
753B MoE · similar size
Q4_K_M · 424.7 GB — Won't fit
Qwen3.5 397B-A17B
403B MoE · similar size
Q4_K_M · 227.4 GB — Won't fit
Ornith 1.5 397B-A17B
397B MoE · similar size
Q4_K_M · 224.1 GB — Won't fit

Every model against the M4 · 16 GB →

DeepSeek V4.1 Flash 552B-A16B on other hardware

DeviceTotalTok/s est.
GeForce RTX 4060 Laptop
7.0 GB usable · 256 GB/s
311.0 GB — Won't fit
GeForce RTX 3060 12 GB
10.6 GB usable · 360 GB/s
311.0 GB — Won't fit
GeForce RTX 4090
22.4 GB usable · 1008 GB/s
311.0 GB — Won't fit
Radeon RX 7900 XTX
22.4 GB usable · 960 GB/s
311.0 GB — Won't fit
M3 Max · 64 GB
48.0 GB usable · 400 GB/s
311.0 GB — Won't fit
M3 Ultra · 512 GB
384.0 GB usable · 800 GB/s
311.0 GB 23 Runs great

All 114 devices, by tier →