Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama2-7B-exl2

Model card Files Files and versions
xet
Community
Llama2-7B-exl2 / README.md
turboderp's picture
turboderp
Create README.md
7385689 about 2 years ago
preview code
|
raw
history blame
829 Bytes

EXL2 quants of OpenLlama-3B

2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.65 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json