Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,8 @@ base_model: openai/gpt-oss-20b
|
|
| 9 |
|
| 10 |
Using llama.cpp branch `gpt-oss-mxfp4`, PR here: https://github.com/ggml-org/llama.cpp/pull/15091
|
| 11 |
|
|
|
|
|
|
|
| 12 |
Original model: https://huggingface.co/openai/gpt-oss-20b
|
| 13 |
|
| 14 |
This is a single static quant in the new MXFP4 format, rest of sizes will come after PR is merged
|
|
|
|
| 9 |
|
| 10 |
Using llama.cpp branch `gpt-oss-mxfp4`, PR here: https://github.com/ggml-org/llama.cpp/pull/15091
|
| 11 |
|
| 12 |
+
You must use that branch in order to run the model
|
| 13 |
+
|
| 14 |
Original model: https://huggingface.co/openai/gpt-oss-20b
|
| 15 |
|
| 16 |
This is a single static quant in the new MXFP4 format, rest of sizes will come after PR is merged
|