Home › Can my computer run it?

Can my computer run it?

Pick your graphics card or Mac and see which popular open-weight AI models fit in its memory, at three common quantizations. Sizes come from each model's files on Hugging Face, and the few without a file are worked out from the parameter count. These are estimates: real use depends on the app, the context length and your settings.

Pick your hardware to see what fits.

Estimated memory needed = GGUF file size + 1.5 GB for the context cache and runtime (about 8K tokens of context). Vision models include their image-encoder file. 1 GB = 1,000,000,000 bytes, the unit Hugging Face uses for file sizes.
ModelParametersQ4Q8FP16ContextFitDownload
Llama 3.2 3B InstructLlama · llama3.23.2B3.5 GBfile 2.0 GB4.9 GBfile 3.4 GB7.9 GBfile 6.4 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 0.9 GB file
Qwen3 4BQwen · apache-2.04.0B4.0 GBfile 2.5 GB5.8 GBfile 4.3 GB9.6 GBfile 8.1 GB40KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 1.1 GB file
Gemma 3 4BGemma · gemma · vision4.3B4.8 GBfile 2.5 GB6.5 GBfile 4.1 GB10.1 GBfile 7.8 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 1.2 GB file
Qwen3.5 4BQwen · apache-2.04.7B4.2 GBfile 2.7 GB6.0 GBfile 4.5 GB9.9 GBfile 8.4 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ2_XXS, 1.5 GB file
Mistral 7B Instruct v0.3Mistral · apache-2.07.2B5.9 GBfile 4.4 GB9.2 GBfile 7.7 GB16.0 GBcomputed: params × 2 bytes32KPick hardwareGGUF files ↗Smallest build: IQ1_S, 1.6 GB file
DeepSeek R1 Distill Qwen 7BDeepSeek · mit7.6B6.2 GBfile 4.7 GB9.6 GBfile 8.1 GB16.7 GBfile 15.2 GB128KPick hardwareGGUF files ↗Smallest build: Q2_K, 3.0 GB file
Gemma 4 E4BGemma · apache-2.0 · vision8.0B7.5 GBfile 5.0 GB10.7 GBfile 8.2 GB17.5 GBfile 15.1 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ2_M, 3.5 GB file
Llama 3.1 8B InstructLlama · llama3.18.0B6.4 GBfile 4.9 GB10.0 GBfile 8.5 GB17.6 GBcomputed: params × 2 bytes128KPick hardwareGGUF files ↗Smallest build: IQ2_M, 2.9 GB file
Qwen3 8BQwen · apache-2.08.2B6.5 GBfile 5.0 GB10.2 GBfile 8.7 GB17.9 GBfile 16.4 GB40KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 2.3 GB file
Qwen3 VL 8B InstructQwen · apache-2.0 · vision8.8B7.7 GBfile 5.0 GB11.4 GBfile 8.7 GB19.0 GBfile 16.4 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 2.3 GB file
Qwen3.5 9BQwen · apache-2.09.7B7.2 GBfile 5.7 GB11.0 GBfile 9.5 GB19.4 GBfile 17.9 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ2_XXS, 3.2 GB file
Gemma 4 12BGemma · apache-2.0 · vision12.0B8.8 GBfile 7.1 GB14.3 GBfile 12.7 GB25.5 GBfile 23.8 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ2_M, 4.2 GB file
Gemma 3 12BGemma · gemma · vision12.2B9.7 GBfile 7.3 GB14.9 GBfile 12.5 GB25.9 GBfile 23.5 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 3.1 GB file
Mistral Nemo Instruct (12B)Mistral · apache-2.012.2B9.0 GBfile 7.5 GB14.5 GBfile 13.0 GB26.0 GBfile 24.5 GB1000KPick hardwareGGUF files ↗Smallest build: Q2_K, 4.8 GB file
Phi-4 (14B)Phi · mit14.7B10.4 GBfile 8.9 GB17.1 GBfile 15.6 GB30.8 GBfile 29.3 GB16KPick hardwareGGUF files ↗Smallest build: Q2_K, 5.6 GB file
Qwen3 14BQwen · apache-2.014.8B10.5 GBfile 9.0 GB17.2 GBfile 15.7 GB31.0 GBfile 29.5 GB40KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 3.8 GB file
DeepSeek R1 Distill Qwen 14BDeepSeek · mit14.8B10.5 GBfile 9.0 GB17.2 GBfile 15.7 GB31.0 GBfile 29.5 GB128KPick hardwareGGUF files ↗Smallest build: Q2_K, 5.8 GB file
gpt-oss-20bgpt-oss · apache-2.0 · coding20.9B13.1 GBfile 11.6 GB13.6 GBfile 12.1 GB15.3 GBfile 13.8 GB128KPick hardwareGGUF files ↗Weights ship natively in MXFP4 (about 4-bit), so the Q4, Q8 and F16 GGUF files are close in size.
Mistral Small 3.2 24B InstructMistral · apache-2.0 · vision24.0B16.7 GBfile 14.3 GB27.4 GBfile 25.1 GB49.5 GBfile 47.2 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 5.6 GB file
Gemma 4 26B-A4B (MoE)Gemma · apache-2.0 · vision25.8B19.6 GBfile 16.9 GB (UD-Q4_K_M)29.6 GBfile 26.9 GB53.2 GBfile 50.5 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ2_XXS, 9.9 GB file
Gemma 3 27BGemma · gemma · vision27.4B18.9 GBfile 16.5 GB31.1 GBfile 28.7 GB56.4 GBfile 54.0 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 6.5 GB file
Qwen3.8 27BQwen · apache-2.0 · coding27.8B18.0 GBfile 16.5 GB (UD-Q4_K_M)30.5 GBfile 29.0 GB56.2 GBfile 54.7 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 6.2 GB file
Qwen3 30B-A3B (MoE)Qwen · apache-2.030.5B20.1 GBfile 18.6 GB34.0 GBfile 32.5 GB62.6 GBfile 61.1 GB40KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 9.0 GB file
Qwen3 Coder 30B-A3B Instruct (MoE)Qwen · apache-2.0 · coding30.5B20.1 GBfile 18.6 GB34.0 GBfile 32.5 GB62.6 GBfile 61.1 GB256KPick hardwareGGUF files ↗Smallest build: Q1_0, 8.0 GB file
Granite 4.0 H Small (32B MoE)Granite · apache-2.032.2B21.1 GBfile 19.6 GB35.8 GBfile 34.3 GB65.9 GBfile 64.4 GB1024KPick hardwareGGUF files ↗Smallest build: Q1_0, 8.7 GB file
Qwen3 32BQwen · apache-2.032.8B21.3 GBfile 19.8 GB36.3 GBfile 34.8 GB67.0 GBfile 65.5 GB40KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 7.7 GB file
DeepSeek R1 Distill Qwen 32BDeepSeek · mit32.8B21.4 GBfile 19.9 GB36.3 GBfile 34.8 GB67.0 GBfile 65.5 GB128KPick hardwareGGUF files ↗Smallest build: Q2_K, 12.3 GB file
Qwen3.6 35B-A3B (MoE)Qwen · apache-2.0 · coding36.0B23.6 GBfile 22.1 GB (UD-Q4_K_M)38.4 GBfile 36.9 GB70.9 GBfile 69.4 GB256KPick hardwareGGUF files ↗Smallest build: UD-IQ1_M, 10.0 GB file
Llama 3.3 70B InstructLlama · llama3.370.6B44.0 GBfile 42.5 GB76.5 GBfile 75.0 GB142.6 GBfile 141.1 GB128KPick hardwareGGUF files ↗Smallest build: UD-IQ1_S, 15.9 GB file
gpt-oss-120bgpt-oss · apache-2.0 · coding116.8B64.3 GBfile 62.8 GB64.9 GBfile 63.4 GB66.9 GBfile 65.4 GB128KPick hardwareGGUF files ↗Weights ship natively in MXFP4 (about 4-bit), so the Q4, Q8 and F16 GGUF files are close in size.
Reflection Beam 1.0 501B-A23B (MoE)Beam · apache-2.0 · coding501.3B23.4B active308.0 GBfile 306.5 GB (UD-Q4_K_XL)534.3 GBfile 532.8 GB1004.2 GBfile 1002.7 GB1024KPick hardwareGGUF files ↗Also published as safetensors: BF16 1,002.7 GB, FP8 503.3 GB (reflection/Beam-1.0-501B-A23B-FP8), NVFP4 293.6 GB (reflection/Beam-1.0-501B-A23B-NVFP4).Smallest build: UD-IQ1_S, 103.1 GB file

How we estimate

Model data checked on Hugging Face on Oct 16, 2026. 31 models. Sizes are estimates, not a guarantee. See also How we verify.