Add sizes to quant list
Browse files
README.md
CHANGED
@@ -22,18 +22,18 @@ If you are looking for a program to run this model with, then I would recommend
|
|
22 |
Clicking on a link will download the corresponding quant instantly.
|
23 |
| Link | Quant | Size | Notes
|
24 |
|:-----|:-----|--------:|:------|
|
25 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-f32.bin) | F32 |
|
26 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-f16.bin) | F16 |
|
27 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q8_0.bin) | Q8_0 |
|
28 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q6_k.bin) | Q6_K |
|
29 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_k.bin) | Q5_K |
|
30 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_1.bin) | Q5_1 |
|
31 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_0.bin) | Q5_0 |
|
32 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_k.bin) | Q4_K |
|
33 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_1.bin) | Q4_1 |
|
34 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_0.bin) | Q4_0 |
|
35 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q3_k.bin) | Q3_K |
|
36 |
-
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q2_k.bin) | Q2_K |
|
37 |
|
38 |
The F16 quant was taken from [ggerganov/whisper.cpp/ggml-small.en.bin](https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-small.en.bin).
|
39 |
## Questions you may have
|
|
|
22 |
Clicking on a link will download the corresponding quant instantly.
|
23 |
| Link | Quant | Size | Notes
|
24 |
|:-----|:-----|--------:|:------|
|
25 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-f32.bin) | F32 | 968 MB | Likely overkill. |
|
26 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-f16.bin) | F16 | 488 MB | Performs better than Q8_0 for noisy audio and music. |
|
27 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q8_0.bin) | Q8_0 | 264 MB | Sweet spot; superficial quality loss at nearly double the speed. |
|
28 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q6_k.bin) | Q6_K | 207 MB | |
|
29 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_k.bin) | Q5_K | 175 MB | |
|
30 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_1.bin) | Q5_1 | 190 MB | |
|
31 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q5_0.bin) | Q5_0 | 175 MB | Last "good" quant; anything below loses quality rapidly. |
|
32 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_k.bin) | Q4_K | 145 MB | *Might* not have lost too much quality, but I'm not sure. |
|
33 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_1.bin) | Q4_1 | 160 MB | |
|
34 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q4_0.bin) | Q4_0 | 145 MB | |
|
35 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q3_k.bin) | Q3_K | 114 MB | |
|
36 |
+
| [GGML](https://huggingface.co/Pomni/whisper-small.en-ggml-allquants/resolve/main/ggml-small.en-q2_k.bin) | Q2_K | 89.7 MB | Completely non-sensical outputs. |
|
37 |
|
38 |
The F16 quant was taken from [ggerganov/whisper.cpp/ggml-small.en.bin](https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-small.en.bin).
|
39 |
## Questions you may have
|