Commit
·
e20b847
1
Parent(s):
3e76622
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ datasets:
|
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER!
|
| 18 |
-
We acheived such a feat by essentially compressing [GPT2](https://huggingface.co/gpt2) and squeezing it to
|
| 19 |
|
| 20 |
## Uses
|
| 21 |
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
|
|
|
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER!
|
| 18 |
+
We acheived such a feat by essentially compressing [GPT2](https://huggingface.co/gpt2) and squeezing it to fit into one sub-GB pytorch.bin file!
|
| 19 |
|
| 20 |
## Uses
|
| 21 |
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
|