pytorch
/

Qwen3-8B-INT4

Text Generation

text-generation-inference

Model card Files Files and versions

jerryzh168 commited on May 16

Commit

79f6c87

·

verified ·

1 Parent(s): 595697d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -226,7 +226,7 @@ lm_eval --model hf --model_args pretrained=$MODEL --tasks hellaswag --device cud
 | Benchmark        |                |                                |
 |------------------|----------------|--------------------------------|
 |                  | Qwen3-8B       | Qwen3-8B-int4wo-hqq            |
-| Peak Memory (GB) | 6.41           | 6.27 (2% reduction)            |
 ## Code Example

 | Benchmark        |                |                                |
 |------------------|----------------|--------------------------------|
 |                  | Qwen3-8B       | Qwen3-8B-int4wo-hqq            |
+| Peak Memory (GB) | 16.47          | 6.27 (62% reduction)           |
 ## Code Example