Mac Mini M4 Pro (24GB)
$1,399
The M4 Pro with 24GB offers a massive bandwidth upgrade over the base M4, making it ideal for developers who need fast inference on 7B-30B models.
Specifications
Memory 24GB UNIFIED
Memory Bandwidth 273 GB/s
GPU Cores 20
CPU Cores 14
TDP 30W
Max Model (Q4) 44B parameters
Max Model (Q8) 22B parameters
Performance Tier Mid
Category Apple Silicon
Performance Benchmarks
Llama 8B Q4 (tok/s) 55
SDXL 1024px (seconds) 10s
Flux 1024px (seconds) 30s
Pros
- 2x memory bandwidth vs M4 base
- Excellent tokens/sec for small-mid models
- Pro-grade CPU for multitasking
Cons
- 24GB limits larger model support
- Significant price jump from M4 base
- Not upgradeable
Compatible Models (Q4)
Models that fit in 24GB at Q4 quantization
Llama 3.2 8B Instruct 8B
6GB required Llama 3.2 3B Instruct 3B
3.5GB required Mistral 7B Instruct v0.3 7B
5.5GB required Gemma 3 27B Instruct 27B
15.5GB required Gemma 3 12B Instruct 12B
8GB required DeepSeek Coder V2 Instruct 236B
12.5GB required Qwen2.5 Coder 32B Instruct 32B
18GB required Qwen2.5 Coder 7B Instruct 7B
5.5GB required CodeLlama 34B Instruct 34B
19GB required StarCoder2 15B 15B
9.5GB required DeepSeek Coder 6.7B Instruct 6.7B
5.35GB required DeepSeek R1 671B
20.5GB required DeepSeek R1 Distill Qwen 32B 32B
18GB required DeepSeek R1 Distill Qwen 7B 7B
5.5GB required QwQ 32B 32B
18GB required Phi-4 14B
9GB required FLUX.1 Schnell 12B
6GB required FLUX.1 Dev 12B
6GB required Stable Diffusion XL Base 1.0 3.5B
3GB required Stable Diffusion 3.5 Large 8B
5GB required + 8 more models
Compatible at Q8
22 models can run at Q8 quantization