kl
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -80,7 +80,7 @@ generated_ids = [
|
|
80 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
81 |
```
|
82 |
|
83 |
-
For deployment, you can use sglang>=0.4.
|
84 |
- SGLang:
|
85 |
|
86 |
```shell
|
|
|
80 |
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
81 |
```
|
82 |
|
83 |
+
For deployment, you can use sglang>=0.4.9.post1 to create an OpenAI-compatible API endpoint:
|
84 |
- SGLang:
|
85 |
|
86 |
```shell
|