Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
This is an example model to show how to run autoround format for visual langugae model on vLLM. Some visual modules have been quantized with 8 bits
|
| 2 |
|
| 3 |
this pr https://github.com/vllm-project/vllm/pull/21802 is required.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model:
|
| 3 |
+
- Qwen/Qwen2.5-VL-7B-Instruct
|
| 4 |
+
---
|
| 5 |
This is an example model to show how to run autoround format for visual langugae model on vLLM. Some visual modules have been quantized with 8 bits
|
| 6 |
|
| 7 |
this pr https://github.com/vllm-project/vllm/pull/21802 is required.
|