Hugging Face's logo

RefalMachine
/
ruadapt_llama3_8b_instruct_extended_lep_ft

Safetensors
Russian
English
llama
Model card Files
xet
Community
1
RefalMachine commited on
Commit
89f4399
·
verified ·
1 Parent(s): c3287d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -9,7 +9,9 @@ language:
9
 
10
  # Model description
11
 
12
- LoRa tuned version of RefalMachine/llama3_extended_darulm_20_05_24_part1-2_64000_bpe_full_lr2e4_bs256 after LEP (Learned Embedding Propagation, paper will be soon) procedure on saiga_scored d7 dataset.
 
 
13
 
14
  # How to cite:
15
 
 
9
 
10
  # Model description
11
 
12
+ LoRa tuned version of ruadapt llama 3 8B with extended tokenizer after LEP (Learned Embedding Propagation, paper will be soon) procedure on saiga_scored d7 dataset.
13
+
14
+ Thanks to the extended tokenizer, the model works more efficiently with the Russian language.
15
 
16
  # How to cite:
17