TheCluster commited on
Commit
c1d4637
·
verified ·
1 Parent(s): aba99c9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -5
README.md CHANGED
@@ -1,5 +1,37 @@
1
- ---
2
- license: other
3
- license_name: qwen
4
- license_link: LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: qwen
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct/blob/main/LICENSE
5
+ pipeline_tag: text-generation
6
+ base_model: Qwen/Qwen2.5-Math-7B-Instruct
7
+ base_model_relation: quantized
8
+ tags:
9
+ - math
10
+ - chat
11
+ - 6bit
12
+ - apple
13
+ language:
14
+ - en
15
+ - zh
16
+ library_name: mlx
17
+ ---
18
+ # Qwen2.5 Math 7B Instruct 6-bit MLX
19
+ MLX version of **Qwen2.5 Math 7B Instruct**
20
+
21
+ This model was converted to MLX format from [`https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct`]() using mlx-lm version **0.22.5**.
22
+
23
+ ## Model Details
24
+
25
+
26
+ For more details, please refer to [blog post](https://qwenlm.github.io/blog/qwen2.5-math/) and [GitHub repo](https://github.com/QwenLM/Qwen2.5-Math).
27
+
28
+
29
+ ## Use with mlx
30
+
31
+ ```bash
32
+ pip install -U mlx-lm
33
+ ```
34
+
35
+ ```bash
36
+ python -m mlx_lm.generate --model TheCluster/Qwen2.5-Math-7B-Instruct-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$."
37
+ ```