erax commited on
Commit
8228817
·
verified ·
1 Parent(s): 0f6982a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -269,7 +269,7 @@ thread.join()
269
  - "Dịch sang tiếng Cantonese"
270
  - "Dịch sang tiếng Cổ Văn Trung Hoa"
271
 
272
- You can also use **vLLM docker** to run to get fatest speed (80 tokens/second) and use Ollama to connect to http://localhost:8000/v1
273
  ```
274
  docker pull thusinh1969/vllm_gemma3:latest
275
  docker run --rm -it --entrypoint "/usr/bin/bash" --gpus '"device=1"' -v ./:/models --shm-size=32gb -p 8005:8000 thusinh1969/vllm_gemma3:latest \
 
269
  - "Dịch sang tiếng Cantonese"
270
  - "Dịch sang tiếng Cổ Văn Trung Hoa"
271
 
272
+ You can also use **vLLM docker** to run to get fatest speed (80 tokens/second) and use Ollama to connect to http://localhost:8005/v1
273
  ```
274
  docker pull thusinh1969/vllm_gemma3:latest
275
  docker run --rm -it --entrypoint "/usr/bin/bash" --gpus '"device=1"' -v ./:/models --shm-size=32gb -p 8005:8000 thusinh1969/vllm_gemma3:latest \