Update README.md
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ Since my role is not as a working developer, but as an solutions architect helpi
|
|
| 28 |
|
| 29 |
| Model Name | Vocabulary Size | Description |
|
| 30 |
| --- | --- | --- |
|
| 31 |
-
| Original phi-2 | 50,295 | BBPE |
|
| 32 |
| **phi-2-ko** | 66,676 | BBPE. Added Korean vocab and merges |
|
| 33 |
|
| 34 |
**Tokenizing "아마존 세이지메이커"**
|
|
|
|
| 28 |
|
| 29 |
| Model Name | Vocabulary Size | Description |
|
| 30 |
| --- | --- | --- |
|
| 31 |
+
| Original phi-2 | 50,295 | BBPE (Byte-level BPE) |
|
| 32 |
| **phi-2-ko** | 66,676 | BBPE. Added Korean vocab and merges |
|
| 33 |
|
| 34 |
**Tokenizing "아마존 세이지메이커"**
|