Llama 3.2 3B & 1B GGUF Quants - a hugging-quants Collection

hugging-quants 's Collections

Gemma2 AWQ Quants

Llama 3.2 3B & 1B GGUF Quants

Llama 3.1 GPTQ, AWQ, and BNB Quants

Llama 3.2 3B & 1B GGUF Quants

updated Sep 26, 2024

Llama.cpp compatible quants for Llama 3.2 3B and 1B Instruct models.

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 4.68k • 51
hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 6.65k • 20
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 22.5k • 34
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 50.2k • 16