Taja Kuzman
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -115,8 +115,9 @@ The model can be used for classification into topic labels from the
|
|
| 115 |
[IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
|
| 116 |
applied to any news text in a language, supported by the `xlm-roberta-large`.
|
| 117 |
|
| 118 |
-
Based on
|
| 119 |
-
the model achieves accuracy of 0.
|
|
|
|
| 120 |
|
| 121 |
## Intended use and limitations
|
| 122 |
|
|
|
|
| 115 |
[IPTC NewsCodes schema](https://iptc.org/std/NewsCodes/guidelines/#_what_are_the_iptc_newscodes) and can be
|
| 116 |
applied to any news text in a language, supported by the `xlm-roberta-large`.
|
| 117 |
|
| 118 |
+
Based on a manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
|
| 119 |
+
the model achieves accuracy of 0.84 and macro-F1 scores of 0.78 on instances, predicted with confidence level above 0.90 (80% of test set).
|
| 120 |
+
If we do not filter out instances, predicted with lower confidence score, the model achieves still a high accuracy of 0.78 and macro-F1 score of 0.72.
|
| 121 |
|
| 122 |
## Intended use and limitations
|
| 123 |
|