Update README.md
Browse files
README.md
CHANGED
@@ -6,7 +6,7 @@ base_model:
|
|
6 |
---
|
7 |
# PJMixers-Dev/LLaMa-3.2-Text-Cleaner-v0.1-1B
|
8 |
|
9 |
-
Model was trained at 16,384 max length, so potentially 8K input 8K output. Model will likely *heavily* reformat text, but hopefully end up with a cleaner result.
|
10 |
|
11 |
Probably not good for cleaning something you need to be 100% accurate to the original, like educational texts, but probably fine for cleaning creative writing datasets.
|
12 |
|
|
|
6 |
---
|
7 |
# PJMixers-Dev/LLaMa-3.2-Text-Cleaner-v0.1-1B
|
8 |
|
9 |
+
Model was trained at 16,384 max length, so potentially 8K input 8K output. Model will likely *heavily* reformat text, but hopefully end up with a cleaner result. 36,603,909 tokens, 18,552,131 of them supervised.
|
10 |
|
11 |
Probably not good for cleaning something you need to be 100% accurate to the original, like educational texts, but probably fine for cleaning creative writing datasets.
|
12 |
|