pipenetwork commited on
Commit
46646be
·
verified ·
1 Parent(s): 46f183c

Add proper model card

Browse files
Files changed (1) hide show
  1. README.md +46 -1
README.md CHANGED
@@ -1,7 +1,52 @@
1
  ---
2
- language: en
3
  library_name: mlx
4
  pipeline_tag: text-generation
 
 
 
 
5
  tags:
6
  - mlx
 
 
7
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: mit
3
  library_name: mlx
4
  pipeline_tag: text-generation
5
+ language:
6
+ - en
7
+ base_model: deepreinforce-ai/Ornith-1.0-397B
8
+ base_model_relation: quantized
9
  tags:
10
  - mlx
11
+ - qwen3_5_moe
12
+ - moe
13
  ---
14
+
15
+ # Ornith-1.0-397B-mlx-4bit
16
+
17
+ This is an **MLX** conversion of [deepreinforce-ai/Ornith-1.0-397B](https://huggingface.co/deepreinforce-ai/Ornith-1.0-397B), quantized to **4-bit** for use on Apple Silicon with [mlx-lm](https://github.com/ml-explore/mlx-lm).
18
+
19
+ - **Base model:** [deepreinforce-ai/Ornith-1.0-397B](https://huggingface.co/deepreinforce-ai/Ornith-1.0-397B) (Qwen3.5-MoE, `Qwen3_5MoeForConditionalGeneration`, 397B total / MoE)
20
+ - **Format:** MLX, 4-bit (affine)
21
+ - **Approx. size on disk:** ~223 GB
22
+ - **Converted with:** mlx-lm 0.31.2
23
+
24
+ > **Note — text-only.** The original Ornith-1.0-397B is multimodal (vision encoder + language model). mlx-lm converts the **language model only**; the vision tower is not included. This build is for **text generation**. The tokenizer, chat template, and `generation_config` are included.
25
+
26
+ ## Requirements
27
+
28
+ This is a large MoE model. You need an Apple Silicon Mac with enough unified memory to hold the weights (roughly **~223 GB** plus runtime overhead/KV cache). A 512 GB M3 Ultra runs all of these comfortably.
29
+
30
+ ## Usage
31
+
32
+ ```bash
33
+ pip install -U mlx-lm
34
+ ```
35
+
36
+ ```bash
37
+ mlx_lm.generate --model pipenetwork/Ornith-1.0-397B-mlx-4bit \
38
+ --prompt "Write a haiku about Apple Silicon." --max-tokens 256
39
+ ```
40
+
41
+ ```python
42
+ from mlx_lm import load, generate
43
+
44
+ model, tokenizer = load("pipenetwork/Ornith-1.0-397B-mlx-4bit")
45
+ messages = [{"role": "user", "content": "Explain mixture-of-experts in one paragraph."}]
46
+ prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True)
47
+ print(generate(model, tokenizer, prompt=prompt, max_tokens=512, verbose=True))
48
+ ```
49
+
50
+ ## License
51
+
52
+ MIT, inherited from the base model.
Free AI Image Generator No sign-up. Instant results. Open Now