Taja Kuzman
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -217,7 +217,16 @@ Label distribution in the training dataset:
|
|
217 |
The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
|
218 |
The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
|
219 |
|
220 |
-
The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
221 |
|
222 |
### Fine-tuning hyperparameters
|
223 |
|
|
|
217 |
The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
|
218 |
The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
|
219 |
|
220 |
+
The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72. The results for the entire test set and per language:
|
221 |
+
|
222 |
+
| Language | Accuracy | Macro-F1 | No. of instances |
|
223 |
+
|:-------|-----------:|-----------:|-----------:|
|
224 |
+
| All (combined) | 0.784071 | 0.723079 | 1130 |
|
225 |
+
| | | | |
|
226 |
+
| Croatian | 0.786942 | 0.732721 | 291 |
|
227 |
+
| Catalan | 0.752809 | 0.676812 | 267 |
|
228 |
+
| Slovenian | 0.80212 | 0.736939 | 283 |
|
229 |
+
| Greek | 0.792388 | 0.725062 | 289 |
|
230 |
|
231 |
### Fine-tuning hyperparameters
|
232 |
|