gguf-org
/

quant-type

Model card Files Files and versions

4.97 MB

2 contributors

History: 18 commits

calcuis's picture

Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf

b3d2620 verified 4 months ago

.gitattributes

2.4 kB

Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf 4 months ago
README.md

88 Bytes

Update README.md 4 months ago
i-quant-iq3_s.gguf

254 kB
xet

Upload i-quant-iq3_s.gguf with huggingface_hub 4 months ago
i-quant-iq3_xxs.gguf

226 kB
xet

Upload i-quant-iq3_xxs.gguf with huggingface_hub 4 months ago
i-quant-iq4_nl.gguf

332 kB
xet

Upload i-quant-iq4_nl.gguf with huggingface_hub 4 months ago
i-quant-iq4_xs.gguf

314 kB
xet

Upload i-quant-iq4_xs.gguf with huggingface_hub 4 months ago
k-quant-q2_k.gguf

194 kB
xet

Upload k-quant-q2_k.gguf with huggingface_hub 4 months ago
k-quant-q3_k_m.gguf

254 kB
xet

Rename k-quant-q3_k.gguf to k-quant-q3_k_m.gguf 4 months ago
k-quant-q4_k_m.gguf

332 kB
xet

Rename k-quant-q4_k.gguf to k-quant-q4_k_m.gguf 4 months ago
k-quant-q5_k.gguf

406 kB
xet

Upload k-quant-q5_k.gguf with huggingface_hub 4 months ago
k-quant-q6_k.gguf

484 kB
xet

Upload k-quant-q6_k.gguf with huggingface_hub 4 months ago
s-quant-q4_0.gguf

332 kB
xet

Upload s-quant-q4_0.gguf with huggingface_hub 4 months ago
s-quant-q4_1.gguf

369 kB
xet

Upload s-quant-q4_1.gguf with huggingface_hub 4 months ago
s-quant-q5_0.gguf

406 kB
xet

Upload s-quant-q5_0.gguf with huggingface_hub 4 months ago
s-quant-q5_1.gguf

443 kB
xet

Upload s-quant-q5_1.gguf with huggingface_hub 4 months ago
s-quant-q8_0.gguf

627 kB
xet

Upload s-quant-q8_0.gguf with huggingface_hub 4 months ago