Update README.md
Browse files
README.md
CHANGED
@@ -22,7 +22,7 @@ Use it directly or serve using [vLLM](https://docs.vllm.ai/en/latest/) for 62% V
|
|
22 |
Install vllm nightly and torchao nightly to get some recent changes:
|
23 |
```
|
24 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
25 |
-
pip install torchao
|
26 |
```
|
27 |
|
28 |
## Serving
|
@@ -55,8 +55,7 @@ this is expected be resolved in pytorch 2.8.
|
|
55 |
Install the required packages:
|
56 |
```Shell
|
57 |
pip install git+https://github.com/huggingface/transformers@main
|
58 |
-
pip install torchao
|
59 |
-
pip install torch
|
60 |
pip install accelerate
|
61 |
```
|
62 |
|
@@ -114,8 +113,7 @@ print("content:", content)
|
|
114 |
Install the required packages:
|
115 |
```Shell
|
116 |
pip install git+https://github.com/huggingface/transformers@main
|
117 |
-
pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/cu126
|
118 |
-
pip install torch
|
119 |
pip install accelerate
|
120 |
```
|
121 |
|
|
|
22 |
Install vllm nightly and torchao nightly to get some recent changes:
|
23 |
```
|
24 |
pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
25 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
26 |
```
|
27 |
|
28 |
## Serving
|
|
|
55 |
Install the required packages:
|
56 |
```Shell
|
57 |
pip install git+https://github.com/huggingface/transformers@main
|
58 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
|
|
59 |
pip install accelerate
|
60 |
```
|
61 |
|
|
|
113 |
Install the required packages:
|
114 |
```Shell
|
115 |
pip install git+https://github.com/huggingface/transformers@main
|
116 |
+
pip install --pre torchao torch --index-url https://download.pytorch.org/whl/nightly/cu126
|
|
|
117 |
pip install accelerate
|
118 |
```
|
119 |
|