Best LLMs for 64 GB to 128 GB of Unified Memory

By LLM Hardware team · Methodology ·

Key facts

70B
44 GB at Q4, 86 GB at Q8 by our VRAM formula
Does not fit 128 GB
Beam Q4 is 302.8 GB. Muse Spark Open Q4 is 491.6 GB
Checked
2026-10-17

Checked 2026-10-17. Author: LLM Hardware team. This site does not store or show Amazon prices. Check current price on Amazon.

Citeable facts

Key fact: A 70B at Q4 needs about 44 GB and at Q8 about 86 GB.

How we got it: VRAM formula: params x bytes x 1.2 + 2.

Checked:

Key fact: DGX Spark lists 273 GB/s; the Ryzen AI Max+ 395 uses 256-bit LPDDR5x-8000 (256 GB/s); the Mac Studio M5 Max lists 460 or 614 GB/s.

How we got it: NVIDIA, AMD and Apple spec pages, checked 14 October 2026.

Checked:

Key fact: gpt-oss-120b has 117B total and 5.1B active parameters and fits one 80 GB GPU per OpenAI.

How we got it: gpt-oss-120b model card.

Checked:

Key fact: Muse Spark Open at Q4 is 491.6 GB and does not fit 128 GB. Nemotron 3.5 Super VL at Q4 is 74 GB and does.

How we got it: 816 x 0.5 x 1.2 + 2 and 120 x 0.5 x 1.2 + 2. Hugging Face and NVIDIA cards, 15 October 2026.

Checked:

Key fact: Beam at Q4 is 302.8 GB and does not fit 128 GB. The smallest published Unsloth file is 103.1 GB. ollama run beam is a cloud tag.

How we got it: Safetensors total 501,267,612,352 on reflection/Beam-1.0-501B-A23B, 17 October 2026. 501.3 x 0.5 x 1.2 + 2 = 302.8. Unsloth UD-IQ1_S shard sum 103,059,961,380 bytes. Ollama library tag beam:cloud the same day.

Checked:

Methodology — parameter math, quantization bytes, and the source list.

64 GB to 128 GB of memory is where 70B dense models and large mixture-of-experts models become possible on one desk. This tier is unified memory, not a discrete GPU: an Apple Mac Studio, an AMD Ryzen AI Max+ 395 (Strix Halo) mini PC, or an NVIDIA DGX Spark. By our VRAM formula (params x bytes x 1.2 + 2), a 70B at Q4 is 44 GB and at Q8 is 86 GB.

What fits at 64 GB, 96 GB and 128 GB

ModelQuantVRAM formula64 GB96 GB128 GB
Llama 3.3 70BQ444 GBYesYesYes
Llama 3.3 70BQ886 GBNoTightYes
Qwen3-32BQ840.4 GBYesYesYes
gpt-oss-120b (MoE)native MXFP4OpenAI: fits one 80 GB GPUNoYesYes
Nemotron 3.5 Super VL (120B total)Q474 GBNoYes, tightYes
Nemotron 3.5 Bolt (74B total)Q446.4 GBYes, tight after the OSYesYes
Muse Spark Open (816B total)Q4491.6 GBNoNoNo
Beam (501.3B total)Q4302.8 GBNoNoNo. UD-IQ1_S file is 103.1 GB
Qwen3-235B-A22B (MoE)Q4143 GBNoNoNo

Leave room for the operating system: unified memory is shared with it, so a 64 GB machine does not give a model all 64 GB. AMD lists up to 128 GB of LPDDR5x-8000 on a 256-bit bus for the Ryzen AI Max+ 395, which works out to 256 GB/s. Qwen3-235B-A22B at Q4 needs 143 GB and only fits the 256 GB or 512 GB Mac Studio configurations.

Reflection Beam, published 16 October 2026, is 501.3B total and 23.4B active, Apache-2.0, text only, 1M context. Q4 is 302.8 GB, so 64 GB, 96 GB, and 128 GB all miss it. Unsloth’s UD-Q4_K_XL files summed to 306.5 GB on 17 October and miss a 256 GB machine. UD-IQ1_S summed to 103.1 GB: that file can sit on 128 GB and does not fit 96 GB. It is a 1-bit file, not Q4. ollama run beam is the cloud tag beam:cloud, not a local weight. Ollama listed nemotron-3.5-super:120b-a12b-q4_K_M at 90GB the same day, which is tighter than the 74 GB formula: 96 GB is the edge after macOS, and 128 GB fits that file. Q8 of Super was listed at 133GB and does not fit 128 GB. Size a different quant in the VRAM calculator. The 24 GB side of Bolt is on the Bolt hardware page, and the three machines are compared in DGX Spark vs Mac Studio vs Strix Halo.

Capacity versus bandwidth

MachineMemory optionsMemory bandwidth (vendor)
Mac Studio M5 Max36 GB; 48, 64 or 128 GB on the 40-core GPU chip460 GB/s; 614 GB/s on the 40-core GPU chip
Mac Studio M5 Ultra96, 256 or 512 GB1.2 TB/s on the 80-core GPU chip
Ryzen AI Max+ 395 (Strix Halo)up to 128 GB256 GB/s (256-bit LPDDR5x-8000)
NVIDIA DGX Spark64 GB or 128 GB273 GB/s

Every one of these has more memory than any single consumer GPU, but less bandwidth than a 24 GB RTX 4090 (1,008 GB/s). A dense 70B reads all 44 GB of weights per token, so it is slow on a 256-273 GB/s box. MoE models with few active parameters, such as gpt-oss-120b (5.1B active), suit this tier best. The head-to-head is in DGX Spark vs Mac Studio vs Strix Halo.

When another option is better

Hardware for this tier

Check current price on Amazon. Mac Studio 64 GB and larger configurations are ordered from Apple; DGX Spark is listed on NVIDIA.

GMKtec EVO-X2 128 GB on Amazon

ASIN B0F53MLYQ6. Amazon Associates link. The live price is on that page, not locked in here.

Mac Studio M5 Max 36 GB on Amazon

ASIN B0HGKSQMX6. Amazon Associates link. The live price is on that page, not locked in here.

Sources

Questions

Can 64 GB run a 70B model?

Yes at Q4: about 44 GB by our VRAM formula, leaving room for the OS and context. Q8 needs 86 GB.

Is 128 GB enough for Qwen3-235B?

Not at Q4: it needs about 143 GB by our VRAM formula. The 256 GB or 512 GB Mac Studio fits it.

Does 128 GB run Reflection Beam?

Not at Q4. Beam is 501.3B total and 23.4B active. Q4 is 302.8 GB. Unsloth UD-Q4_K_XL is 306.5 GB and misses 256 GB. The smallest Unsloth file, UD-IQ1_S, is 103.1 GB and can sit on 128 GB. It does not fit 96 GB. ollama run beam is beam:cloud, not that file. Weights: https://huggingface.co/reflection/Beam-1.0-501B-A23B

A correction or a hardware question goes to the contact page.