thuannh commited on
Commit
33375eb
·
verified ·
1 Parent(s): d541459

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -3
README.md CHANGED
@@ -48,18 +48,21 @@ Jan-v1 is optimized for direct integration with the [Jan App](https://jan.ai/).
48
 
49
  **Using vLLM:**
50
  ```bash
51
- vllm serve Menlo/Jan-v1 \
52
  --host 0.0.0.0 \
53
  --port 1234 \
54
  --enable-auto-tool-choice \
55
  --tool-call-parser hermes
 
56
  ```
57
 
58
  **Using llama.cpp:**
59
  ```bash
60
- llama-server --model jan-v1.gguf \
61
  --host 0.0.0.0 \
62
- --port 1234
 
 
63
  ```
64
 
65
  ### Recommended Parameters
 
48
 
49
  **Using vLLM:**
50
  ```bash
51
+ vllm serve janhq/Jan-v1-4B \
52
  --host 0.0.0.0 \
53
  --port 1234 \
54
  --enable-auto-tool-choice \
55
  --tool-call-parser hermes
56
+
57
  ```
58
 
59
  **Using llama.cpp:**
60
  ```bash
61
+ llama-server --model Jan-v1-4B-Q4_K_M.gguf \
62
  --host 0.0.0.0 \
63
+ --port 1234 \
64
+ --jinja \
65
+ --no-context-shift
66
  ```
67
 
68
  ### Recommended Parameters