Taja Kuzman commited on
Commit
2e7b1ad
·
verified ·
1 Parent(s): b83f6f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -217,7 +217,16 @@ Label distribution in the training dataset:
217
  The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
218
  The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
219
 
220
- The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72.
 
 
 
 
 
 
 
 
 
221
 
222
  ### Fine-tuning hyperparameters
223
 
 
217
  The model was evaluated on a manually-annotated test set in four languages (Croatian, Slovenian, Catalan and Greek), consisting of 1.130 instances.
218
  The test set contains equal amounts of texts from the four languages and is more or less balanced across labels.
219
 
220
+ The model was shown to achieve accuracy of 0.78 and macro-F1 scores of 0.72. The results for the entire test set and per language:
221
+
222
+ | Language | Accuracy | Macro-F1 | No. of instances |
223
+ |:-------|-----------:|-----------:|-----------:|
224
+ | All (combined) | 0.784071 | 0.723079 | 1130 |
225
+ | | | | |
226
+ | Croatian | 0.786942 | 0.732721 | 291 |
227
+ | Catalan | 0.752809 | 0.676812 | 267 |
228
+ | Slovenian | 0.80212 | 0.736939 | 283 |
229
+ | Greek | 0.792388 | 0.725062 | 289 |
230
 
231
  ### Fine-tuning hyperparameters
232