gguf-org
/

quant-type

Model card Files Files and versions

3.5 MB

2 contributors

History: 13 commits

calcuis's picture

Upload s-quant-q4_1.gguf with huggingface_hub

0d43e7f verified 4 months ago

.gitattributes

2.12 kB

Upload s-quant-q4_1.gguf with huggingface_hub 4 months ago
README.md

88 Bytes

Update README.md 4 months ago
i-quant-iq3_s.gguf

254 kB
xet

Upload i-quant-iq3_s.gguf with huggingface_hub 4 months ago
i-quant-iq3_xxs.gguf

226 kB
xet

Upload i-quant-iq3_xxs.gguf with huggingface_hub 4 months ago
i-quant-iq4_nl.gguf

332 kB
xet

Upload i-quant-iq4_nl.gguf with huggingface_hub 4 months ago
i-quant-iq4_xs.gguf

314 kB
xet

Upload i-quant-iq4_xs.gguf with huggingface_hub 4 months ago
k-quant-q2_k.gguf

194 kB
xet

Upload k-quant-q2_k.gguf with huggingface_hub 4 months ago
k-quant-q3_k.gguf

254 kB
xet

Upload k-quant-q3_k.gguf with huggingface_hub 4 months ago
k-quant-q4_k.gguf

332 kB
xet

Upload k-quant-q4_k.gguf with huggingface_hub 4 months ago
k-quant-q5_k.gguf

406 kB
xet

Upload k-quant-q5_k.gguf with huggingface_hub 4 months ago
k-quant-q6_k.gguf

484 kB
xet

Upload k-quant-q6_k.gguf with huggingface_hub 4 months ago
s-quant-q4_0.gguf

332 kB
xet

Upload s-quant-q4_0.gguf with huggingface_hub 4 months ago
s-quant-q4_1.gguf

369 kB
xet

Upload s-quant-q4_1.gguf with huggingface_hub 4 months ago