File size: 4,623 Bytes
3a9acf4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
| Tasks | Version | Filter | n-shot | Metric | Value | ± | Stderr |
|------------------------------|---------|-----------------------|--------|----------|-------|----|--------|
| assin2_rte | 1.1 | all | 15 | f1_macro | 0.9358| ± | 0.0035 |
| | | all | 15 | acc | 0.9359| ± | 0.0035 |
| assin2_sts | 1.1 | all | 15 | pearson | 0.7803| ± | 0.0068 |
| | | all | 15 | mse | 0.5815| ± | N/A |
| bluex | 1.1 | all | 3 | acc | 0.6745| ± | 0.0101 |
| | | exam_id__USP_2019 | 3 | acc | 0.5500| ± | 0.0453 |
| | | exam_id__UNICAMP_2021_1| 3 | acc | 0.5870| ± | 0.0418 |
| | | exam_id__USP_2020 | 3 | acc | 0.6250| ± | 0.0373 |
| | | exam_id__USP_2022 | 3 | acc | 0.6939| ± | 0.0381 |
| | | exam_id__UNICAMP_2019 | 3 | acc | 0.7200| ± | 0.0367 |
| | | exam_id__UNICAMP_2024 | 3 | acc | 0.5778| ± | 0.0425 |
| | | exam_id__USP_2018 | 3 | acc | 0.5926| ± | 0.0385 |
| | | exam_id__USP_2021 | 3 | acc | 0.6538| ± | 0.0381 |
| | | exam_id__UNICAMP_2023 | 3 | acc | 0.7442| ± | 0.0385 |
| | | exam_id__UNICAMP_2021_2| 3 | acc | 0.6667| ± | 0.0380 |
| | | exam_id__UNICAMP_2020 | 3 | acc | 0.7091| ± | 0.0355 |
| | | exam_id__USP_2023 | 3 | acc | 0.8182| ± | 0.0336 |
| | | exam_id__USP_2024 | 3 | acc | 0.8537| ± | 0.0318 |
| | | exam_id__UNICAMP_2022 | 3 | acc | 0.6667| ± | 0.0435 |
| | | exam_id__UNICAMP_2018 | 3 | acc | 0.6852| ± | 0.0364 |
| enem | 1.1 | all | 3 | acc | 0.8062| ± | 0.0060 |
| | | exam_id__2016_2 | 3 | acc | 0.7967| ± | 0.0210 |
| | | exam_id__2014 | 3 | acc | 0.8165| ± | 0.0214 |
| | | exam_id__2010 | 3 | acc | 0.8291| ± | 0.0202 |
| | | exam_id__2023 | 3 | acc | 0.8000| ± | 0.0199 |
| | | exam_id__2009 | 3 | acc | 0.7913| ± | 0.0219 |
| | | exam_id__2017 | 3 | acc | 0.7931| ± | 0.0217 |
| | | exam_id__2011 | 3 | acc | 0.8718| ± | 0.0178 |
| | | exam_id__2015 | 3 | acc | 0.8151| ± | 0.0205 |
| | | exam_id__2012 | 3 | acc | 0.8621| ± | 0.0185 |
| | | exam_id__2016 | 3 | acc | 0.8430| ± | 0.0190 |
| | | exam_id__2013 | 3 | acc | 0.7870| ± | 0.0228 |
| | | exam_id__2022 | 3 | acc | 0.6842| ± | 0.0233 |
| faquad_nli | 1.1 | all | 15 | f1_macro | 0.4545| ± | 0.0081 |
| | | all | 15 | acc | 0.7877| ± | 0.0113 |
| hatebr_offensive_binary | 1.0 | all | 25 | f1_macro | 0.7212| ± | 0.0087 |
| | | all | 25 | acc | 0.7393| ± | 0.0083 |
| oab_exams | 1.5 | all | 3 | acc | 0.5718| ± | 0.0061 |
| | | exam_id__2014-15 | 3 | acc | 0.6795| ± | 0.0305 |
| | | exam_id__2012-09 | 3 | acc | 0.4805| ± | 0.0329 |
...
|