Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,8 @@ huggingface-cli download onnxruntime/DeepSeek-R1-Distill-ONNX --include 'deepsee
|
|
| 20 |
```
|
| 21 |
|
| 22 |
```bash
|
|
|
|
|
|
|
| 23 |
# CPU Chat inference. If you pulled the model from huggingface, adjust the model directory (-m) accordingly
|
| 24 |
curl -o https://raw.githubusercontent.com/microsoft/onnxruntime-genai/refs/heads/main/examples/python/model-chat.py
|
| 25 |
python model-chat.py -m deepseek-r1-distill-qwen-1.5B/model -e cpu --chat_template "<|begin▁of▁sentence|><|User|>{input}<|Assistant|>"
|
|
|
|
| 20 |
```
|
| 21 |
|
| 22 |
```bash
|
| 23 |
+
pip install requests numpy --pre onnxruntime-genai"
|
| 24 |
+
|
| 25 |
# CPU Chat inference. If you pulled the model from huggingface, adjust the model directory (-m) accordingly
|
| 26 |
curl -o https://raw.githubusercontent.com/microsoft/onnxruntime-genai/refs/heads/main/examples/python/model-chat.py
|
| 27 |
python model-chat.py -m deepseek-r1-distill-qwen-1.5B/model -e cpu --chat_template "<|begin▁of▁sentence|><|User|>{input}<|Assistant|>"
|