Update README.md
Browse files
README.md
CHANGED
@@ -269,7 +269,7 @@ thread.join()
|
|
269 |
- "Dịch sang tiếng Cantonese"
|
270 |
- "Dịch sang tiếng Cổ Văn Trung Hoa"
|
271 |
|
272 |
-
You can also use **vLLM docker** to run to get fatest speed (80 tokens/second) and use Ollama to connect to http://localhost:
|
273 |
```
|
274 |
docker pull thusinh1969/vllm_gemma3:latest
|
275 |
docker run --rm -it --entrypoint "/usr/bin/bash" --gpus '"device=1"' -v ./:/models --shm-size=32gb -p 8005:8000 thusinh1969/vllm_gemma3:latest \
|
|
|
269 |
- "Dịch sang tiếng Cantonese"
|
270 |
- "Dịch sang tiếng Cổ Văn Trung Hoa"
|
271 |
|
272 |
+
You can also use **vLLM docker** to run to get fatest speed (80 tokens/second) and use Ollama to connect to http://localhost:8005/v1
|
273 |
```
|
274 |
docker pull thusinh1969/vllm_gemma3:latest
|
275 |
docker run --rm -it --entrypoint "/usr/bin/bash" --gpus '"device=1"' -v ./:/models --shm-size=32gb -p 8005:8000 thusinh1969/vllm_gemma3:latest \
|