gpt-oss-120b

Detailed guide for using this model with llama.cpp:

https://github.com/ggml-org/llama.cpp/discussions/15396

Quick start:

llama-server -hf ggml-org/gpt-oss-120b-GGUF -c 0 -fa --jinja

# Then, access http://localhost:8080
Downloads last month
32,889
GGUF
Model size
117B params
Architecture
gpt-oss
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/gpt-oss-120b-GGUF

Quantized
(34)
this model

Collection including ggml-org/gpt-oss-120b-GGUF