Update README.md
Browse files
README.md
CHANGED
|
@@ -119,7 +119,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
| 119 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
| 120 |
```
|
| 121 |
|
| 122 |
-
## int4wo-hqq
|
| 123 |
```
|
| 124 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
|
| 125 |
```
|
|
|
|
| 119 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
| 120 |
```
|
| 121 |
|
| 122 |
+
## int4 weight only quantization with hqq (int4wo-hqq)
|
| 123 |
```
|
| 124 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-int4wo-hqq --tasks hellaswag --device cuda:0 --batch_size 8
|
| 125 |
```
|