gguf-org
/

quant-type

Model card Files Files and versions

Ctrl+K

Ctrl+K

2 contributors

History: 16 commits

calcuis's picture

Upload s-quant-q8_0.gguf with huggingface_hub

e1b6db3 verified about 2 months ago

.gitattributes

2.28 kB

Upload s-quant-q8_0.gguf with huggingface_hub about 2 months ago
README.md

88 Bytes

Update README.md about 2 months ago
i-quant-iq3_s.gguf

254 kB
xet

Upload i-quant-iq3_s.gguf with huggingface_hub about 2 months ago
i-quant-iq3_xxs.gguf

226 kB
xet

Upload i-quant-iq3_xxs.gguf with huggingface_hub about 2 months ago
i-quant-iq4_nl.gguf

332 kB
xet

Upload i-quant-iq4_nl.gguf with huggingface_hub about 2 months ago
i-quant-iq4_xs.gguf

314 kB
xet

Upload i-quant-iq4_xs.gguf with huggingface_hub about 2 months ago
k-quant-q2_k.gguf

194 kB
xet

Upload k-quant-q2_k.gguf with huggingface_hub about 2 months ago
k-quant-q3_k.gguf

254 kB
xet

Upload k-quant-q3_k.gguf with huggingface_hub about 2 months ago
k-quant-q4_k.gguf

332 kB
xet

Upload k-quant-q4_k.gguf with huggingface_hub about 2 months ago
k-quant-q5_k.gguf

406 kB
xet

Upload k-quant-q5_k.gguf with huggingface_hub about 2 months ago
k-quant-q6_k.gguf

484 kB
xet

Upload k-quant-q6_k.gguf with huggingface_hub about 2 months ago
s-quant-q4_0.gguf

332 kB
xet

Upload s-quant-q4_0.gguf with huggingface_hub about 2 months ago
s-quant-q4_1.gguf

369 kB
xet

Upload s-quant-q4_1.gguf with huggingface_hub about 2 months ago
s-quant-q5_0.gguf

406 kB
xet

Upload s-quant-q5_0.gguf with huggingface_hub about 2 months ago
s-quant-q5_1.gguf

443 kB
xet

Upload s-quant-q5_1.gguf with huggingface_hub about 2 months ago
s-quant-q8_0.gguf

627 kB
xet

Upload s-quant-q8_0.gguf with huggingface_hub about 2 months ago