Update README.md
Browse files
README.md
CHANGED
|
@@ -46,9 +46,9 @@ model.quantize(examples)
|
|
| 46 |
model.save_quantized(quantized_model_dir)
|
| 47 |
```
|
| 48 |
|
| 49 |
-
Evaluated through
|
| 50 |
|
| 51 |
-
```
|
| 52 |
#!/bin/bash
|
| 53 |
|
| 54 |
# Example usage:
|
|
|
|
| 46 |
model.save_quantized(quantized_model_dir)
|
| 47 |
```
|
| 48 |
|
| 49 |
+
Evaluated through vLLM>=0.5.1 with the following script:
|
| 50 |
|
| 51 |
+
```bash
|
| 52 |
#!/bin/bash
|
| 53 |
|
| 54 |
# Example usage:
|