Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Regularization via Adaptive Pairwise Label Smoothing   Label Smoothing (LS) is an effective regularizer to improve the
generalization of state-of-the-art deep models. For each training sample the LS
strategy smooths the one-hot encoded training signal by distributing its
distribution mass over the non ground-truth classes, aiming to penalize the
networks from generating overconfident output distributions. This paper
introduces a novel label smoothing technique called Pairwise Label Smoothing
(PLS). The PLS takes a pair of samples as input. Smoothing with a pair of
ground-truth labels enables the PLS to preserve the relative distance between
the two truth labels while further soften that between the truth labels and the
other targets, resulting in models producing much less confident predictions
than the LS strategy. Also, unlike current LS methods, which typically require
to find a global smoothing distribution mass through cross-validation search,
PLS automatically learns the distribution mass for each input pair during
training. We empirically show that PLS significantly outperforms LS and the
baseline models, achieving up to 30% of relative classification error
reduction. We also visually show that when achieving such accuracy gains the
PLS tends to produce very low winning softmax scores.

37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat