Update README.md
Browse files
README.md
CHANGED
@@ -49,6 +49,13 @@ model.save_quantized(quant_path)
|
|
49 |
tokenizer.save_pretrained(quant_path)
|
50 |
```
|
51 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
52 |
## Running the AWQ file
|
53 |
|
54 |
TBD
|
|
|
49 |
tokenizer.save_pretrained(quant_path)
|
50 |
```
|
51 |
|
52 |
+
## Library versions used for quantization
|
53 |
+
|
54 |
+
```raw
|
55 |
+
autoawq 0.2.6
|
56 |
+
autoawq_kernels 0.0.7
|
57 |
+
```
|
58 |
+
|
59 |
## Running the AWQ file
|
60 |
|
61 |
TBD
|