Hugging Face's logo

ggml-org
/
gpt-oss-120b-GGUF

GGUF
conversational
Model card Files
xet
Community
3
ggerganov commited on
Commit
0764c15
·
verified ·
1 Parent(s): 583c738

readme : update

Browse files
Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -2,12 +2,16 @@
2
  base_model:
3
  - openai/gpt-oss-120b
4
  ---
5
- # GPT OSS 120B GGUF
6
 
7
- Recommended way to run this model:
 
 
 
 
8
 
9
  ```sh
10
- llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja --reasoning-format none
11
 
12
  # Then, access http://localhost:8080
13
  ```
 
2
  base_model:
3
  - openai/gpt-oss-120b
4
  ---
5
+ # gpt-oss-120b
6
 
7
+ Detailed guide for using this model with `llama.cpp`:
8
+
9
+ https://github.com/ggml-org/llama.cpp/discussions/15396
10
+
11
+ Quick start:
12
 
13
  ```sh
14
+ llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja
15
 
16
  # Then, access http://localhost:8080
17
  ```