Key fact: A 70B at Q4 needs about 44 GB and at Q8 about 86 GB.
How we got it: VRAM formula: params x bytes x 1.2 + 2.
Checked:
By LLM Hardware team · Methodology ·
Checked 2026-10-17. Author: LLM Hardware team. This site does not store or show Amazon prices. Check current price on Amazon.
Key fact: A 70B at Q4 needs about 44 GB and at Q8 about 86 GB.
How we got it: VRAM formula: params x bytes x 1.2 + 2.
Checked:
Key fact: DGX Spark lists 273 GB/s; the Ryzen AI Max+ 395 uses 256-bit LPDDR5x-8000 (256 GB/s); the Mac Studio M5 Max lists 460 or 614 GB/s.
How we got it: NVIDIA, AMD and Apple spec pages, checked 14 October 2026.
Checked:
Key fact: gpt-oss-120b has 117B total and 5.1B active parameters and fits one 80 GB GPU per OpenAI.
How we got it: gpt-oss-120b model card.
Checked:
Key fact: Muse Spark Open at Q4 is 491.6 GB and does not fit 128 GB. Nemotron 3.5 Super VL at Q4 is 74 GB and does.
How we got it: 816 x 0.5 x 1.2 + 2 and 120 x 0.5 x 1.2 + 2. Hugging Face and NVIDIA cards, 15 October 2026.
Checked:
Key fact: Beam at Q4 is 302.8 GB and does not fit 128 GB. The smallest published Unsloth file is 103.1 GB. ollama run beam is a cloud tag.
How we got it: Safetensors total 501,267,612,352 on reflection/Beam-1.0-501B-A23B, 17 October 2026. 501.3 x 0.5 x 1.2 + 2 = 302.8. Unsloth UD-IQ1_S shard sum 103,059,961,380 bytes. Ollama library tag beam:cloud the same day.
Checked:
Methodology — parameter math, quantization bytes, and the source list.
64 GB to 128 GB of memory is where 70B dense models and large mixture-of-experts models become possible on one desk. This tier is unified memory, not a discrete GPU: an Apple Mac Studio, an AMD Ryzen AI Max+ 395 (Strix Halo) mini PC, or an NVIDIA DGX Spark. By our VRAM formula (params x bytes x 1.2 + 2), a 70B at Q4 is 44 GB and at Q8 is 86 GB.
| Model | Quant | VRAM formula | 64 GB | 96 GB | 128 GB |
|---|---|---|---|---|---|
| Llama 3.3 70B | Q4 | 44 GB | Yes | Yes | Yes |
| Llama 3.3 70B | Q8 | 86 GB | No | Tight | Yes |
| Qwen3-32B | Q8 | 40.4 GB | Yes | Yes | Yes |
| gpt-oss-120b (MoE) | native MXFP4 | OpenAI: fits one 80 GB GPU | No | Yes | Yes |
| Nemotron 3.5 Super VL (120B total) | Q4 | 74 GB | No | Yes, tight | Yes |
| Nemotron 3.5 Bolt (74B total) | Q4 | 46.4 GB | Yes, tight after the OS | Yes | Yes |
| Muse Spark Open (816B total) | Q4 | 491.6 GB | No | No | No |
| Beam (501.3B total) | Q4 | 302.8 GB | No | No | No. UD-IQ1_S file is 103.1 GB |
| Qwen3-235B-A22B (MoE) | Q4 | 143 GB | No | No | No |
Leave room for the operating system: unified memory is shared with it, so a 64 GB machine does not give a model all 64 GB. AMD lists up to 128 GB of LPDDR5x-8000 on a 256-bit bus for the Ryzen AI Max+ 395, which works out to 256 GB/s. Qwen3-235B-A22B at Q4 needs 143 GB and only fits the 256 GB or 512 GB Mac Studio configurations.
Reflection Beam, published 16 October 2026, is 501.3B total and 23.4B active, Apache-2.0, text only, 1M context. Q4 is 302.8 GB, so 64 GB, 96 GB, and 128 GB all miss it. Unsloth’s UD-Q4_K_XL files summed to 306.5 GB on 17 October and miss a 256 GB machine. UD-IQ1_S summed to 103.1 GB: that file can sit on 128 GB and does not fit 96 GB. It is a 1-bit file, not Q4. ollama run beam is the cloud tag beam:cloud, not a local weight. Ollama listed nemotron-3.5-super:120b-a12b-q4_K_M at 90GB the same day, which is tighter than the 74 GB formula: 96 GB is the edge after macOS, and 128 GB fits that file. Q8 of Super was listed at 133GB and does not fit 128 GB. Size a different quant in the VRAM calculator. The 24 GB side of Bolt is on the Bolt hardware page, and the three machines are compared in DGX Spark vs Mac Studio vs Strix Halo.
| Machine | Memory options | Memory bandwidth (vendor) |
|---|---|---|
| Mac Studio M5 Max | 36 GB; 48, 64 or 128 GB on the 40-core GPU chip | 460 GB/s; 614 GB/s on the 40-core GPU chip |
| Mac Studio M5 Ultra | 96, 256 or 512 GB | 1.2 TB/s on the 80-core GPU chip |
| Ryzen AI Max+ 395 (Strix Halo) | up to 128 GB | 256 GB/s (256-bit LPDDR5x-8000) |
| NVIDIA DGX Spark | 64 GB or 128 GB | 273 GB/s |
Every one of these has more memory than any single consumer GPU, but less bandwidth than a 24 GB RTX 4090 (1,008 GB/s). A dense 70B reads all 44 GB of weights per token, so it is slow on a 256-273 GB/s box. MoE models with few active parameters, such as gpt-oss-120b (5.1B active), suit this tier best. The head-to-head is in DGX Spark vs Mac Studio vs Strix Halo.
Check current price on Amazon. Mac Studio 64 GB and larger configurations are ordered from Apple; DGX Spark is listed on NVIDIA.
GMKtec EVO-X2 128 GB on Amazon
ASIN B0F53MLYQ6. Amazon Associates link. The live price is on that page, not locked in here.
Mac Studio M5 Max 36 GB on Amazon
ASIN B0HGKSQMX6. Amazon Associates link. The live price is on that page, not locked in here.
Yes at Q4: about 44 GB by our VRAM formula, leaving room for the OS and context. Q8 needs 86 GB.
Not at Q4: it needs about 143 GB by our VRAM formula. The 256 GB or 512 GB Mac Studio fits it.
Not at Q4. Beam is 501.3B total and 23.4B active. Q4 is 302.8 GB. Unsloth UD-Q4_K_XL is 306.5 GB and misses 256 GB. The smallest Unsloth file, UD-IQ1_S, is 103.1 GB and can sit on 128 GB. It does not fit 96 GB. ollama run beam is beam:cloud, not that file. Weights: https://huggingface.co/reflection/Beam-1.0-501B-A23B
A correction or a hardware question goes to the contact page.