Complete quant list
Browse files
README.md
CHANGED
|
@@ -27,13 +27,11 @@ This is a repository of **GGML quants for [distil-medium.en](https://huggingface
|
|
| 27 |
|
| 28 |
If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
|
| 29 |
## List of Quants
|
| 30 |
-
I am still in the middle of creating quants right now. The most important quants that I deem to be "useful in real-world usage" (being able to provide acceptably accurate transcriptions) are already up however.
|
| 31 |
-
|
| 32 |
Clicking on a link will download the corresponding quant instantly.
|
| 33 |
| Link | Quant | Size | Notes
|
| 34 |
|:-----|:-----|--------:|:------|
|
| 35 |
-
| [GGML](https://huggingface.co/
|
| 36 |
-
| [GGML](https://huggingface.co/
|
| 37 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q8_0.bin) | Q8_0 | 430 MB | Sweet spot; superficial quality loss at nearly double the speed. |
|
| 38 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q6_k.bin) | Q6_K | 336 MB | |
|
| 39 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_k.bin) | Q5_K | 284 MB | |
|
|
|
|
| 27 |
|
| 28 |
If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
|
| 29 |
## List of Quants
|
|
|
|
|
|
|
| 30 |
Clicking on a link will download the corresponding quant instantly.
|
| 31 |
| Link | Quant | Size | Notes
|
| 32 |
|:-----|:-----|--------:|:------|
|
| 33 |
+
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-f32.bin) | F32 | 1.58 GB | Likely overkill. |
|
| 34 |
+
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-f16.bin) | F16 | 794 MB | Performs better than Q8_0 for noisy audio and music. |
|
| 35 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q8_0.bin) | Q8_0 | 430 MB | Sweet spot; superficial quality loss at nearly double the speed. |
|
| 36 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q6_k.bin) | Q6_K | 336 MB | |
|
| 37 |
| [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_k.bin) | Q5_K | 284 MB | |
|