Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ base_model_relation: quantized
|
|
17 |
Base model: [ByteDance-Seed/Seed-OSS-36B-Instruct](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct)
|
18 |
|
19 |
### 【❗❗Reminder❗❗】
|
20 |
-
|
21 |
|
22 |
### 【vLLM Single Node with 2 GPUs — Startup Command】
|
23 |
```
|
|
|
17 |
Base model: [ByteDance-Seed/Seed-OSS-36B-Instruct](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct)
|
18 |
|
19 |
### 【❗❗Reminder❗❗】
|
20 |
+
Int3 quantization may cause measurable degradation in model accuracy. We recommend exercising caution when using this model.
|
21 |
|
22 |
### 【vLLM Single Node with 2 GPUs — Startup Command】
|
23 |
```
|