Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Mixtral-8x7B-Instruct-v0.1-exl3

Model card Files Files and versions
xet
Community
Mixtral-8x7B-Instruct-v0.1-exl3 / README.md
turboderp's picture
turboderp
Update README.md
e6da0cb verified 4 months ago
preview code
|
raw
history blame
983 Bytes
metadata
license: apache-2.0

EXL3 quants of Mixtral-8x7B-Instruct-v0.1

2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8