Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,7 @@ base_model:
|
|
| 6 |
---
|
| 7 |
# PJMixers-Dev/LLaMa-3.2-Text-Cleaner-v0.1-1B
|
| 8 |
|
| 9 |
-
Model was trained at 16,384 max length, so potentially 8K input 8K output. Model will likely *heavily* reformat text, but hopefully end up with a cleaner result.
|
| 10 |
|
| 11 |
Probably not good for cleaning something you need to be 100% accurate to the original, like educational texts, but probably fine for cleaning creative writing datasets.
|
| 12 |
|
|
|
|
| 6 |
---
|
| 7 |
# PJMixers-Dev/LLaMa-3.2-Text-Cleaner-v0.1-1B
|
| 8 |
|
| 9 |
+
Model was trained at 16,384 max length, so potentially 8K input 8K output. Model will likely *heavily* reformat text, but hopefully end up with a cleaner result. 36,603,909 tokens, 18,552,131 of them supervised.
|
| 10 |
|
| 11 |
Probably not good for cleaning something you need to be 100% accurate to the original, like educational texts, but probably fine for cleaning creative writing datasets.
|
| 12 |
|