Update README.md
Browse files
README.md
CHANGED
@@ -70,11 +70,7 @@ These collections will update over time. Newest items are usually at the bottom
|
|
70 |
|
71 |
<B>Experts Activation / Models used to build this model:</B>
|
72 |
|
73 |
-
|
74 |
-
|
75 |
-
To be updated...
|
76 |
-
|
77 |
-
The mixture of experts is set at 4 experts, but you can use 1, 2, 3, or 4.
|
78 |
|
79 |
This "team" has a Captain (first listed model), and then all the team members contribute to the to "token"
|
80 |
choice billions of times per second. Note the Captain also contributes too.
|
|
|
70 |
|
71 |
<B>Experts Activation / Models used to build this model:</B>
|
72 |
|
73 |
+
The mixture of experts can be set at 1, 2, 4, 8 ... or more experts, but you can use 1, 2, 3, or 4.
|
|
|
|
|
|
|
|
|
74 |
|
75 |
This "team" has a Captain (first listed model), and then all the team members contribute to the to "token"
|
76 |
choice billions of times per second. Note the Captain also contributes too.
|