ModelCloud
/

Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3

Text Generation

4-bit precision

Model card Files Files and versions

lrl-modelcloud commited on Nov 9, 2024

Commit

f9c8ef2

·

verified ·

1 Parent(s): 701a32b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -47,7 +47,7 @@ This model has been quantized using [GPTQModel](https://github.com/ModelCloud/GP
 from transformers import AutoTokenizer
 from gptqmodel import GPTQModel
-model_name = "ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortext-v3"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = GPTQModel.from_quantized(model_name)

 from transformers import AutoTokenizer
 from gptqmodel import GPTQModel
+model_name = "ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = GPTQModel.from_quantized(model_name)