Home › Can my computer run it?
Can my computer run it?
Pick your graphics card or Mac and see which popular open-weight AI models fit in its memory, at three common quantizations. Sizes come from each model's files on Hugging Face, and the few without a file are worked out from the parameter count. These are estimates: real use depends on the app, the context length and your settings.
Pick your hardware to see what fits.
| Model | Parameters | Q4 | Q8 | FP16 | Context | Fit | Download |
|---|---|---|---|---|---|---|---|
| Llama 3.2 3B Instruct | 3.2B | 3.5 GB | 4.9 GB | 7.9 GB | 128K | Pick hardware | GGUF files ↗ |
| Qwen3 4B | 4.0B | 4.0 GB | 5.8 GB | 9.6 GB | 40K | Pick hardware | GGUF files ↗ |
| Gemma 3 4B | 4.3B | 4.8 GB | 6.5 GB | 10.1 GB | 128K | Pick hardware | GGUF files ↗ |
| Qwen3.5 4B | 4.7B | 4.2 GB | 6.0 GB | 9.9 GB | 256K | Pick hardware | GGUF files ↗ |
| Mistral 7B Instruct v0.3 | 7.2B | 5.9 GB | 9.2 GB | 16.0 GB | 32K | Pick hardware | GGUF files ↗ |
| DeepSeek R1 Distill Qwen 7B | 7.6B | 6.2 GB | 9.6 GB | 16.7 GB | 128K | Pick hardware | GGUF files ↗ |
| Gemma 4 E4B | 8.0B | 7.5 GB | 10.7 GB | 17.5 GB | 128K | Pick hardware | GGUF files ↗ |
| Llama 3.1 8B Instruct | 8.0B | 6.4 GB | 10.0 GB | 17.6 GB | 128K | Pick hardware | GGUF files ↗ |
| Qwen3 8B | 8.2B | 6.5 GB | 10.2 GB | 17.9 GB | 40K | Pick hardware | GGUF files ↗ |
| Qwen3 VL 8B Instruct | 8.8B | 7.7 GB | 11.4 GB | 19.0 GB | 256K | Pick hardware | GGUF files ↗ |
| Qwen3.5 9B | 9.7B | 7.2 GB | 11.0 GB | 19.4 GB | 256K | Pick hardware | GGUF files ↗ |
| Gemma 4 12B | 12.0B | 8.8 GB | 14.3 GB | 25.5 GB | 256K | Pick hardware | GGUF files ↗ |
| Gemma 3 12B | 12.2B | 9.7 GB | 14.9 GB | 25.9 GB | 128K | Pick hardware | GGUF files ↗ |
| Mistral Nemo Instruct (12B) | 12.2B | 9.0 GB | 14.5 GB | 26.0 GB | 1000K | Pick hardware | GGUF files ↗ |
| Phi-4 (14B) | 14.7B | 10.4 GB | 17.1 GB | 30.8 GB | 16K | Pick hardware | GGUF files ↗ |
| Qwen3 14B | 14.8B | 10.5 GB | 17.2 GB | 31.0 GB | 40K | Pick hardware | GGUF files ↗ |
| DeepSeek R1 Distill Qwen 14B | 14.8B | 10.5 GB | 17.2 GB | 31.0 GB | 128K | Pick hardware | GGUF files ↗ |
| gpt-oss-20b | 20.9B | 13.1 GB | 13.6 GB | 15.3 GB | 128K | Pick hardware | GGUF files ↗ |
| Mistral Small 3.2 24B Instruct | 24.0B | 16.7 GB | 27.4 GB | 49.5 GB | 128K | Pick hardware | GGUF files ↗ |
| Gemma 4 26B-A4B (MoE) | 25.8B | 19.6 GB | 29.6 GB | 53.2 GB | 256K | Pick hardware | GGUF files ↗ |
| Gemma 3 27B | 27.4B | 18.9 GB | 31.1 GB | 56.4 GB | 128K | Pick hardware | GGUF files ↗ |
| Qwen3.8 27B | 27.8B | 18.0 GB | 30.5 GB | 56.2 GB | 256K | Pick hardware | GGUF files ↗ |
| Qwen3 30B-A3B (MoE) | 30.5B | 20.1 GB | 34.0 GB | 62.6 GB | 40K | Pick hardware | GGUF files ↗ |
| Qwen3 Coder 30B-A3B Instruct (MoE) | 30.5B | 20.1 GB | 34.0 GB | 62.6 GB | 256K | Pick hardware | GGUF files ↗ |
| Granite 4.0 H Small (32B MoE) | 32.2B | 21.1 GB | 35.8 GB | 65.9 GB | 1024K | Pick hardware | GGUF files ↗ |
| Qwen3 32B | 32.8B | 21.3 GB | 36.3 GB | 67.0 GB | 40K | Pick hardware | GGUF files ↗ |
| DeepSeek R1 Distill Qwen 32B | 32.8B | 21.4 GB | 36.3 GB | 67.0 GB | 128K | Pick hardware | GGUF files ↗ |
| Qwen3.6 35B-A3B (MoE) | 36.0B | 23.6 GB | 38.4 GB | 70.9 GB | 256K | Pick hardware | GGUF files ↗ |
| Llama 3.3 70B Instruct | 70.6B | 44.0 GB | 76.5 GB | 142.6 GB | 128K | Pick hardware | GGUF files ↗ |
| gpt-oss-120b | 116.8B | 64.3 GB | 64.9 GB | 66.9 GB | 128K | Pick hardware | GGUF files ↗ |
| Reflection Beam 1.0 501B-A23B (MoE) | 501.3B | 308.0 GB | 534.3 GB | 1004.2 GB | 1024K | Pick hardware | GGUF files ↗ |
Nothing in our list fits at Q4. Try a smaller amount of context, or turn off "Only show models that fit" to see what is close.
How we estimate
- Model sizes: the exact size of each model's Q4_K_M, Q8_0 and FP16/BF16 GGUF files, read from the Hugging Face API. Where no FP16 GGUF is published we show parameters × 2 bytes and mark it "computed".
- Parameters: the parameter count Hugging Face lists for the original model (its safetensors total).
- Fits: file size plus about 1.5 GB is at or below your usable memory. Tight: it fits, but within 10% of the limit. Won't fit: more than your memory; on a graphics card it may still run with part of the model on the CPU, but much more slowly.
- Macs: we count about 75% of unified memory as usable, because macOS keeps the rest for itself by default. No graphics card: we also count about 75% of system RAM, leaving room for the OS and apps (our assumption); it runs, but slowly.
- Q4 is the Q4_K_M file; where a repo only publishes an Unsloth Dynamic version we use that and name it (for example UD-Q4_K_XL). When a model only fits as a much smaller build (1- to 3-bit), we say so: those builds lose noticeably more quality.
- Mixture-of-experts models (marked MoE) still need all their weights in memory, even though only part of them is used for each word.
- Longer context (for example 32K or 128K tokens) needs more memory than the 8K we assume. Speed is not estimated here.