Intel
/

DeepSeek-V3.1-int4-mixed-AutoRound

Text Generation

4-bit precision

Model card Files Files and versions

weiweiz1 commited on about 1 month ago

Commit

493e30c

·

verified ·

1 Parent(s): eefe4a2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -112,7 +112,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 import transformers
 from auto_round import AutoRound
-model_name = "deepseek-ai/DeepSeek-V3.1-Base"
 layer_config = {}
 for n, m in model.named_modules():

 import transformers
 from auto_round import AutoRound
+model_name = "deepseek-ai/DeepSeek-V3.1"
 layer_config = {}
 for n, m in model.named_modules():