SteelStorage
/

Lumosia-MoE-4x10.7

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions

Steelskull commited on Jan 8, 2024

Commit

edbcf7c

·

1 Parent(s): 0f09075

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ This model is an extreme experiment, I wanted to test making an MoE out of multi
 This MoE model is an extreme experiment, I wanted to test making an MoE out of multiple High Performing Solar models. Let me know what you think.
 Thinking about finetuning on a RP dataset later on to direct the model more
-- **Model type:** [More Information Needed]
 ### Model Sources [optional]

 This MoE model is an extreme experiment, I wanted to test making an MoE out of multiple High Performing Solar models. Let me know what you think.
 Thinking about finetuning on a RP dataset later on to direct the model more
+- **Model type:** Solar-10.7
 ### Model Sources [optional]