please make a 70 dense model and more smaller sizes
#53
by Manni1000 - opened
please make a 70 dense model something like qwen 3.8 70b dense
i remember qwen 3.5 had way more sizes. a 122b 10b a would also be interesting or a 35b 3b a but also smaller sizes like a 0.8b or 2b or 4 b or 9b or like i said 70b. the old llama models had a 70 b variant i think it would be interesting how good a 70b dense qwen could be.
Manni1000 changed discussion title from please make a 70 dense model something like qwen 3.8 70b dense to please make a 70 dense model and more smaller sizes
7b dense version is pretty good option
you have to send them a twitt because they don't read here