JunHowie commited on
Commit
3972257
·
verified ·
1 Parent(s): 8e91b6a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ base_model_relation: quantized
17
  Base model: [ByteDance-Seed/Seed-OSS-36B-Instruct](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct)
18
 
19
  ### 【❗❗Reminder❗❗】
20
- The model suffers from significant loss under 3-bit quantization, please use with caution.
21
 
22
  ### 【vLLM Single Node with 2 GPUs — Startup Command】
23
  ```
 
17
  Base model: [ByteDance-Seed/Seed-OSS-36B-Instruct](https://huggingface.co/ByteDance-Seed/Seed-OSS-36B-Instruct)
18
 
19
  ### 【❗❗Reminder❗❗】
20
+ Int3 quantization may cause measurable degradation in model accuracy. We recommend exercising caution when using this model.
21
 
22
  ### 【vLLM Single Node with 2 GPUs — Startup Command】
23
  ```