Pomni commited on
Commit
d155685
·
verified ·
1 Parent(s): de65a9d

Complete quant list

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -27,13 +27,11 @@ This is a repository of **GGML quants for [distil-medium.en](https://huggingface
27
 
28
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
29
  ## List of Quants
30
- I am still in the middle of creating quants right now. The most important quants that I deem to be "useful in real-world usage" (being able to provide acceptably accurate transcriptions) are already up however.
31
-
32
  Clicking on a link will download the corresponding quant instantly.
33
  | Link | Quant | Size | Notes
34
  |:-----|:-----|--------:|:------|
35
- | [GGML](https://huggingface.co/distil-whisper/distil-medium.en/resolve/main/ggml-medium-32-2.en.fp32.bin) | F32 | 1.58 GB | Likely overkill. |
36
- | [GGML](https://huggingface.co/distil-whisper/distil-medium.en/resolve/main/ggml-medium-32-2.en.bin) | F16 | 794 MB | Performs better than Q8_0 for noisy audio and music. |
37
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q8_0.bin) | Q8_0 | 430 MB | Sweet spot; superficial quality loss at nearly double the speed. |
38
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q6_k.bin) | Q6_K | 336 MB | |
39
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_k.bin) | Q5_K | 284 MB | |
 
27
 
28
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and automates a lot of the hard stuff for you.
29
  ## List of Quants
 
 
30
  Clicking on a link will download the corresponding quant instantly.
31
  | Link | Quant | Size | Notes
32
  |:-----|:-----|--------:|:------|
33
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-f32.bin) | F32 | 1.58 GB | Likely overkill. |
34
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-f16.bin) | F16 | 794 MB | Performs better than Q8_0 for noisy audio and music. |
35
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q8_0.bin) | Q8_0 | 430 MB | Sweet spot; superficial quality loss at nearly double the speed. |
36
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q6_k.bin) | Q6_K | 336 MB | |
37
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_k.bin) | Q5_K | 284 MB | |