Update README.md
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ This model [mlx-community/deepseek-coder-v2-lite-instruct-4bit-awq](https://hugg
|
|
| 15 |
converted to MLX format from [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)
|
| 16 |
using mlx-lm version **0.25.2**.
|
| 17 |
|
|
|
|
|
|
|
| 18 |
## Use with mlx
|
| 19 |
|
| 20 |
```bash
|
|
|
|
| 15 |
converted to MLX format from [deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct)
|
| 16 |
using mlx-lm version **0.25.2**.
|
| 17 |
|
| 18 |
+
AWQ Parameters: --bits 4 --group-size 64 --embed-bits 4 --embed-group-size 32 --num-samples 128 --sequence-length 1024 --n-grid 50 with a customized calibration dataset
|
| 19 |
+
|
| 20 |
## Use with mlx
|
| 21 |
|
| 22 |
```bash
|