Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scalable Penalized Regression for Noise Detection in Learning with Noisy
  Labels   Noisy training set usually leads to the degradation of generalization and
robustness of neural networks. In this paper, we propose using a theoretically
guaranteed noisy label detection framework to detect and remove noisy data for
Learning with Noisy Labels (LNL). Specifically, we design a penalized
regression to model the linear relation between network features and one-hot
labels, where the noisy data are identified by the non-zero mean shift
parameters solved in the regression model. To make the framework scalable to
datasets that contain a large number of categories and training data, we
propose a split algorithm to divide the whole training set into small pieces
that can be solved by the penalized regression in parallel, leading to the
Scalable Penalized Regression (SPR) framework. We provide the non-asymptotic
probabilistic condition for SPR to correctly identify the noisy data. While SPR
can be regarded as a sample selection module for standard supervised training
pipeline, we further combine it with semi-supervised algorithm to further
exploit the support of noisy data as unlabeled data. Experimental results on
several benchmark datasets and real-world noisy datasets show the effectiveness
of our framework. Our code and pretrained models are released at
https://github.com/Yikai-Wang/SPR-LNL.

24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th