Taja Kuzman
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -217,7 +217,16 @@ Label distribution in the training dataset:
|
|
| 217 |
The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
|
| 218 |
The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
|
| 219 |
|
| 220 |
-
The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 221 |
|
| 222 |
### Fine-tuning hyperparameters
|
| 223 |
|
|
|
|
| 217 |
The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
|
| 218 |
The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
|
| 219 |
|
| 220 |
+
The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72. The results for the entire test set and per language:
|
| 221 |
+
|
| 222 |
+
| Language | Accuracy | Macro-F1 | No. of instances |
|
| 223 |
+
|:-------|-----------:|-----------:|-----------:|
|
| 224 |
+
| All (combined) | 0.784071 | 0.723079 | 1130 |
|
| 225 |
+
| | | | |
|
| 226 |
+
| Croatian | 0.786942 | 0.732721 | 291 |
|
| 227 |
+
| Catalan | 0.752809 | 0.676812 | 267 |
|
| 228 |
+
| Slovenian | 0.80212 | 0.736939 | 283 |
|
| 229 |
+
| Greek | 0.792388 | 0.725062 | 289 |
|
| 230 |
|
| 231 |
### Fine-tuning hyperparameters
|
| 232 |
|