RodaIA

Qual GPU pra rodar cada modelo

ModeloQ4 (arquivo)Q8 (arquivo)
Llama 3.1 8B Instruct4.9 GB8.5 GB
Llama 3.2 3B Instruct2 GB3.4 GB
Llama 3.3 70B Instruct42.5 GB75 GB
Qwen3 4B2.5 GB4.3 GB
Qwen3 8B5 GB8.7 GB
Qwen3 14B9 GB15.7 GB
Qwen3 32B19.8 GB34.8 GB
Qwen3 30B-A3B18.6 GB32.5 GB
Qwen2.5 Coder 14B9 GB15.7 GB
Qwen2.5 Coder 32B19.9 GB34.8 GB
Gemma 3 4B2.5 GB4.1 GB
Gemma 3 12B7.3 GB12.5 GB
Gemma 3 27B16.5 GB28.7 GB
Mistral Nemo 12B7.5 GB13 GB
Mistral Small 3.2 24B14.3 GB25.1 GB
DeepSeek R1 Distill Qwen 7B4.7 GB8.1 GB
DeepSeek R1 Distill Qwen 14B9 GB15.7 GB
DeepSeek R1 Distill Qwen 32B19.9 GB34.8 GB
DeepSeek R1 Distill Llama 70B42.5 GB75 GB
gpt-oss 20B11.6 GB12.1 GB
gpt-oss 120B62.8 GB63.4 GB
Phi-4 14B9.1 GB15.6 GB