Hugging Face's logo

BUT-FIT
/
CSTinyLlama-1.2B

Text Generation
Transformers
Safetensors
Czech
llama
text-generation-inference
Model card Files
xet
Community
1
mfajcik commited on
Commit
d69577f
·
verified ·
1 Parent(s): e8f8b0c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ language:
6
  - cs
7
  ---
8
  # Introduction
9
- CSTinyLlama-1.2B is a Czech language model continously pretrained on 168b training tokens from English [TinyLLama-2.5T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T) model. Model was pretrained on ~67b token [Large Czech Collection](https://huggingface.co/datasets/BUT-FIT/but_lcc) using Czech tokenizer, obtained using our vocabulary swap method.
10
  Training was done on [Karolina](https://www.it4i.cz/en) cluster.
11
 
12
  # <span style="color:red">BUT LM Model Roster</span>
 
6
  - cs
7
  ---
8
  # Introduction
9
+ CSTinyLlama-1.2B is a Czech language model continously pretrained on 168b training tokens from English [TinyLLama-2.5T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T) model. Model was pretrained on ~67b token [Large Czech Collection](https://huggingface.co/datasets/BUT-FIT/BUT-LCC) using Czech tokenizer, obtained using our vocabulary swap method.
10
  Training was done on [Karolina](https://www.it4i.cz/en) cluster.
11
 
12
  # <span style="color:red">BUT LM Model Roster</span>