Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: When Chosen Wisely, More Data Is What You Need: A Universal
  Sample-Efficient Strategy For Data Augmentation   Data Augmentation (DA) is known to improve the generalizability of deep
neural networks. Most existing DA techniques naively add a certain number of
augmented samples without considering the quality and the added computational
cost of these samples. To tackle this problem, a common strategy, adopted by
several state-of-the-art DA methods, is to adaptively generate or re-weight
augmented samples with respect to the task objective during training. However,
these adaptive DA methods: (1) are computationally expensive and not
sample-efficient, and (2) are designed merely for a specific setting. In this
work, we present a universal DA technique, called Glitter, to overcome both
issues. Glitter can be plugged into any DA method, making training
sample-efficient without sacrificing performance. From a pre-generated pool of
augmented samples, Glitter adaptively selects a subset of worst-case samples
with maximal loss, analogous to adversarial DA. Without altering the training
strategy, the task objective can be optimized on the selected subset. Our
thorough experiments on the GLUE benchmark, SQuAD, and HellaSwag in three
widely used training setups including consistency training, self-distillation
and knowledge distillation reveal that Glitter is substantially faster to train
and achieves a competitive performance, compared to strong baselines.

4
The categories of this paper are: cond-mat
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex