jerryzh168 commited on
Commit
e6ebd63
·
verified ·
1 Parent(s): 6744463

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -22,7 +22,7 @@ Use it directly or serve using [vLLM](https://docs.vllm.ai/en/latest/) for 62% V
22
  Install vllm nightly and torchao nightly to get some recent changes:
23
  ```
24
  pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
25
- pip install torchao
26
  ```
27
 
28
  ## Serving
@@ -55,8 +55,7 @@ this is expected be resolved in pytorch 2.8.
55
  Install the required packages:
56
  ```Shell
57
  pip install git+https://github.com/huggingface/transformers@main
58
- pip install torchao
59
- pip install torch
60
  pip install accelerate
61
  ```
62
 
@@ -114,8 +113,7 @@ print("content:", content)
114
  Install the required packages:
115
  ```Shell
116
  pip install git+https://github.com/huggingface/transformers@main
117
- pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
118
- pip install torch
119
  pip install accelerate
120
  ```
121
 
 
22
  Install vllm nightly and torchao nightly to get some recent changes:
23
  ```
24
  pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
25
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
26
  ```
27
 
28
  ## Serving
 
55
  Install the required packages:
56
  ```Shell
57
  pip install git+https://github.com/huggingface/transformers@main
58
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
 
59
  pip install accelerate
60
  ```
61
 
 
113
  Install the required packages:
114
  ```Shell
115
  pip install git+https://github.com/huggingface/transformers@main
116
+ pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
 
117
  pip install accelerate
118
  ```
119