Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Robustness of Active Learning   Active Learning is concerned with the question of how to identify the most
useful samples for a Machine Learning algorithm to be trained with. When
applied correctly, it can be a very powerful tool to counteract the immense
data requirements of Artificial Neural Networks. However, we find that it is
often applied with not enough care and domain knowledge. As a consequence,
unrealistic hopes are raised and transfer of the experimental results from one
dataset to another becomes unnecessarily hard.
  In this work we analyse the robustness of different Active Learning methods
with respect to classifier capacity, exchangeability and type, as well as
hyperparameters and falsely labelled data. Experiments reveal possible biases
towards the architecture used for sample selection, resulting in suboptimal
performance for other classifiers. We further propose the new "Sum of Squared
Logits" method based on the Simpson diversity index and investigate the effect
of using the confusion matrix for balancing in sample selection.

30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio