Update README.md
Browse files
README.md
CHANGED
@@ -48,18 +48,21 @@ Jan-v1 is optimized for direct integration with the [Jan App](https://jan.ai/).
|
|
48 |
|
49 |
**Using vLLM:**
|
50 |
```bash
|
51 |
-
vllm serve
|
52 |
--host 0.0.0.0 \
|
53 |
--port 1234 \
|
54 |
--enable-auto-tool-choice \
|
55 |
--tool-call-parser hermes
|
|
|
56 |
```
|
57 |
|
58 |
**Using llama.cpp:**
|
59 |
```bash
|
60 |
-
llama-server --model
|
61 |
--host 0.0.0.0 \
|
62 |
-
--port 1234
|
|
|
|
|
63 |
```
|
64 |
|
65 |
### Recommended Parameters
|
|
|
48 |
|
49 |
**Using vLLM:**
|
50 |
```bash
|
51 |
+
vllm serve janhq/Jan-v1-4B \
|
52 |
--host 0.0.0.0 \
|
53 |
--port 1234 \
|
54 |
--enable-auto-tool-choice \
|
55 |
--tool-call-parser hermes
|
56 |
+
|
57 |
```
|
58 |
|
59 |
**Using llama.cpp:**
|
60 |
```bash
|
61 |
+
llama-server --model Jan-v1-4B-Q4_K_M.gguf \
|
62 |
--host 0.0.0.0 \
|
63 |
+
--port 1234 \
|
64 |
+
--jinja \
|
65 |
+
--no-context-shift
|
66 |
```
|
67 |
|
68 |
### Recommended Parameters
|