Update README.md

README.md

@@ -1,3 +1,63 @@
----
-license: apache-2.0
----
+---
+library_name: transformers
+license: apache-2.0
+pipeline_tag: text-generation
+---
+
+# GroveMoE-Inst
+
+## Highlights
+
+We introduce **GroveMoE**, a new sparse architecture using **adjugate experts** for dynamic computation allocation, featuring the following key highlights:
+
+- **Architecture**: Novel **adjugate experts** grouped with ordinary experts; shared computation is executed once, then reused, cutting FLOPs.
+- **Sparse Activation**: 33 B params total, only **3.14–3.28 B** active per token.
+- **Traning**: Mid-training + SFT, up-cycled from Qwen3-30B-A3B-Base; preserves prior knowledge while adding new capabilities.
+
+## Model Lists
+| GroveMoE Series | Download  
+|---|---
+GroveMoE-Base   | 🤗 [HuggingFace](https://huggingface.co/inclusionAI/GroveMoE-Base)
+GroveMoE-Inst  | 🤗 [HuggingFace](https://huggingface.co/inclusionAI/GroveMoE-Inst)
+
+
+## Performance
+
+| Model | Activated Params | MMLU-Pro | SuperGPQA | GPQA-Diamond | Omni-math | AIME'25 | MultiPL-E | LiveCodeBench v6 |
+|:-----:|:----------------:|:------------:|:-------------:|:------------:|:-----------------:|:------------:|:------------------:|:------------------:|
+|Llama4-Scout| 17B | 64.9 | 42.0 | 55.6 | 56.6 | 30.2 | 10.0 | 45.0 | 32.0 |
+|Qwen3-30B-A3B| 3B | 63.3 | 40.5 | 51.7 | 60.3 | 33.7 | 21.7 | 66.0 | 29.4 |
+|Qwen3-32B| 32B | 68.2 | 43.0 | 53.6 | 59.5 | 31.8 | 22.9 | 68.6 | 28.6 |
+|Gemma3-27B-IT| 27B | 67.1 | 35.6 | 45.3 | 59.9 | 33.3 | 23.1 | 65.5 | 30.9 |
+|Mistral-Small-3.2| 24B | 68.1 | 37.5 | 59.9 | 61.9 | 33.4 | 28.1 | 69.5 | 32.2 |
+|GroveMoE-Inst|3.14~3.28B | <font color=#FBD98D>**72.8**</font> | <font color=#FBD98D>**47.7**</font> | <font color=#FBD98D>**61.3**</font> |<font color=#FBD98D>**71.2**</font> |<font color=#FBD98D>**43.5**</font> | <font color=#FBD98D>**44.4**</font> |<font color=#FBD98D>**74.5**</font> | <font color=#FBD98D>**34.6**</font> |
+
+We bold the top1 scores separately for all models.
+
+## Usage
+Below, there are some code snippets on how to get quickly started with running the model. First, install the Transformers library. 
+
+```sh
+$ pip install transformers==4.51.3
+```
+
+Then, copy the snippet from the section that is relevant for your use case.
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+tokenizer = AutoTokenizer.from_pretrained("inclusionAI/GroveMoE-Inst", trust_remote_code=True)
+model = AutoModelForCausalLM.from_pretrained("inclusionAI/GroveMoE-Inst", device_map="auto", trust_remote_code=True).eval()
+inputs = tokenizer('### Human:\nHow are you?\n### Assistant:\n', return_tensors='pt')
+inputs = inputs.to(model.device)
+pred = model.generate(**inputs)
+print(tokenizer.decode(pred.cpu()[0], skip_special_tokens=True))
+```
+
+## Citation
+```bibtex
+@article{GroveMoE,
+title = {GroveMoE: Towards Efficient and Superior MoE LLMs with Adjugate Experts},
+author = {Wu, Haoyuan and Chen, Haoxing and Chen, Xiaodong and Zhou, Zhanchao and Chen, Tieyuan and Zhuang, Yihong and Lu, Guoshan and Zhao, Junbo and Liu, Lin and Huang, Zenan and Lan, Zhenzhong and Yu, Bei and Li, Jianguo},
+journal = {arXiv preprint arXiv:2508.07785},
+year = {2025}
+}
+```