MoLA-LLM
/

MoLA-v0.6-9x4b

Text Generation

mixture-of-experts

Model card Files Files and versions

AtAndDev commited on 3 days ago

Commit

619a8ca

·

verified ·

1 Parent(s): 05f65f3

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -19,7 +19,8 @@ pipeline_tag: text-generation
 MoLA-LM combines multiple LoRA adapters with an intelligent router to automatically select the best adapter for each input prompt. This approach enables specialized performance across different tasks while maintaining efficiency.
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/630f3e4002ce39336c411048/BPSMNsVAEHuODm7hi4mOA.png)
 **Important Note**: *The v0.5 had issues with the lora applying part of the custom lm class and its router was a bit too small with little generalization.
 In v0.6 and future models, all of these issues are/will be resolved.*

 MoLA-LM combines multiple LoRA adapters with an intelligent router to automatically select the best adapter for each input prompt. This approach enables specialized performance across different tasks while maintaining efficiency.
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/630f3e4002ce39336c411048/Zqq0zSEO5WEvG1N4kBUWF.png)
 **Important Note**: *The v0.5 had issues with the lora applying part of the custom lm class and its router was a bit too small with little generalization.
 In v0.6 and future models, all of these issues are/will be resolved.*