gguf-org
/

quant-type

Model card Files Files and versions

5.25 MB

2 contributors

History: 20 commits

chatpig's picture

Upload 2 files

3f83d85 verified 3 months ago

.gitattributes

2.56 kB

Upload 2 files 3 months ago
README.md

88 Bytes

Update README.md 4 months ago
i-quant-iq3_s.gguf

254 kB
xet

Upload i-quant-iq3_s.gguf with huggingface_hub 4 months ago
i-quant-iq3_xxs.gguf

226 kB
xet

Upload i-quant-iq3_xxs.gguf with huggingface_hub 4 months ago
i-quant-iq4_nl.gguf

332 kB
xet

Upload i-quant-iq4_nl.gguf with huggingface_hub 4 months ago
i-quant-iq4_xs.gguf

314 kB
xet

Upload i-quant-iq4_xs.gguf with huggingface_hub 4 months ago
k-quant-q2_k.gguf

194 kB
xet

Upload k-quant-q2_k.gguf with huggingface_hub 4 months ago
k-quant-q3_k_m.gguf

254 kB
xet

Rename k-quant-q3_k.gguf to k-quant-q3_k_m.gguf 4 months ago
k-quant-q4_k_m.gguf

332 kB
xet

Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf 4 months ago
k-quant-q5_k_m.gguf

406 kB
xet

Rename k-quant-q5_k.gguf to k-quant-q5_k_m.gguf 4 months ago
k-quant-q6_k.gguf

484 kB
xet

Upload k-quant-q6_k.gguf with huggingface_hub 4 months ago
s-quant-q4_0.gguf

332 kB
xet

Upload s-quant-q4_0.gguf with huggingface_hub 4 months ago
s-quant-q4_1.gguf

369 kB
xet

Upload s-quant-q4_1.gguf with huggingface_hub 4 months ago
s-quant-q5_0.gguf

406 kB
xet

Upload s-quant-q5_0.gguf with huggingface_hub 4 months ago
s-quant-q5_1.gguf

443 kB
xet

Upload s-quant-q5_1.gguf with huggingface_hub 4 months ago
s-quant-q8_0.gguf

627 kB
xet

Upload s-quant-q8_0.gguf with huggingface_hub 4 months ago
t-quant-tq1_0.gguf

125 kB
xet

Upload 2 files 3 months ago
t-quant-tq2_0.gguf

152 kB
xet

Upload 2 files 3 months ago