Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

gguf-org
/
quant-type

GGUF
Model card Files Files and versions
xet
Community
quant-type
2.8 MB
  • 2 contributors
History: 11 commits
calcuis's picture
calcuis
Upload k-quant-q6_k.gguf with huggingface_hub
9f5c7e9 verified 2 months ago
  • .gitattributes
    2.01 kB
    Upload k-quant-q6_k.gguf with huggingface_hub 2 months ago
  • README.md
    88 Bytes
    Update README.md 2 months ago
  • i-quant-iq3_s.gguf
    254 kB
    xet
    Upload i-quant-iq3_s.gguf with huggingface_hub 2 months ago
  • i-quant-iq3_xxs.gguf
    226 kB
    xet
    Upload i-quant-iq3_xxs.gguf with huggingface_hub 2 months ago
  • i-quant-iq4_nl.gguf
    332 kB
    xet
    Upload i-quant-iq4_nl.gguf with huggingface_hub 2 months ago
  • i-quant-iq4_xs.gguf
    314 kB
    xet
    Upload i-quant-iq4_xs.gguf with huggingface_hub 2 months ago
  • k-quant-q2_k.gguf
    194 kB
    xet
    Upload k-quant-q2_k.gguf with huggingface_hub 2 months ago
  • k-quant-q3_k.gguf
    254 kB
    xet
    Upload k-quant-q3_k.gguf with huggingface_hub 2 months ago
  • k-quant-q4_k.gguf
    332 kB
    xet
    Upload k-quant-q4_k.gguf with huggingface_hub 2 months ago
  • k-quant-q5_k.gguf
    406 kB
    xet
    Upload k-quant-q5_k.gguf with huggingface_hub 2 months ago
  • k-quant-q6_k.gguf
    484 kB
    xet
    Upload k-quant-q6_k.gguf with huggingface_hub 2 months ago