sealad886
/

gpt-oss-120b-MLX-native

Text Generation

4-bit precision

Model card Files Files and versions

sealad886 commited on 16 days ago

Commit

c6a14b3

·

verified ·

1 Parent(s): 3bb3c95

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ using mlx-lm version **0.26.3**.
 > **Note:** command for conversion:
 > ```bash
-> mlx_lm.convert --hf-repo openai/gpt-oss-20b ... -q --q-bits 4
 > ```
 >
 > The version without doing an added 4-bit quant was in a 16-bit format (either bfloat16 or float16, I assume; I didn't check).

 > **Note:** command for conversion:
 > ```bash
+> mlx_lm.convert --hf-repo openai/gpt-oss-120b ... -q --q-bits 4
 > ```
 >
 > The version without doing an added 4-bit quant was in a 16-bit format (either bfloat16 or float16, I assume; I didn't check).