Hugging Face's logo

machinez
/
Codestral-22B-v0.1-exl2

code
text-generation-inference
mistral
Model card Files
xet
Community
machinez commited on
Commit
f6075ef
·
verified ·
1 Parent(s): 12fd1bd

Update README.md

Browse files

added more weight options

Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -27,11 +27,12 @@ python3 convert.py -i ~/models/Codestral-22B-v0.1-hf/ -o /tmp/exl2/ -nr -m ~/mod
27
  ```
28
 
29
  ## Quantization
 
30
  - [4.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/4_0) 11.5gb
31
  - [5.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/5_0) 14.0gb
32
  - [5.5bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/5_5)
33
  - [6.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/6_0) 17.0gb
34
- - [7.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/7_0)
35
  - [8.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/8_0) 21.0gb
36
 
37
  # Model Card for Codestral-22B-v0.1
 
27
  ```
28
 
29
  ## Quantization
30
+ - [3.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/3_0)
31
  - [4.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/4_0) 11.5gb
32
  - [5.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/5_0) 14.0gb
33
  - [5.5bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/5_5)
34
  - [6.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/6_0) 17.0gb
35
+ - [7.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/7_0) 19.7gb
36
  - [8.0bpw](https://huggingface.co/machinez/Codestral-22B-v0.1-exl2/tree/8_0) 21.0gb
37
 
38
  # Model Card for Codestral-22B-v0.1