pytorch
/

Phi-4-mini-instruct-AWQ-INT4

Text Generation

text-generation-inference

Model card Files Files and versions

jerryzh168 commited on Sep 18

Commit

004acbe

·

verified ·

1 Parent(s): 7f81a6b

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -59,7 +59,8 @@ this is expected be resolved in pytorch 2.8.
 Install the required packages:
 ```Shell
-pip install git+https://github.com/huggingface/transformers@main
 pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install accelerate
@@ -123,7 +124,8 @@ print("content:", content)
 Install the required packages:
 ```Shell
-pip install git+https://github.com/huggingface/transformers@main
 pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install accelerate

 Install the required packages:
 ```Shell
+# for compatibility with modeling file in checkpoint
+pip install transformers==4.53.0
 pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install accelerate
 Install the required packages:
 ```Shell
+# for compatibility with modeling file in checkpoint
+pip install transformers==4.53.0
 pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu126
 pip install accelerate