Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Towards Understanding Generalization via Decomposing Excess Risk
  Dynamics   Generalization is one of the fundamental issues in machine learning. However,
traditional techniques like uniform convergence may be unable to explain
generalization under overparameterization. As alternative approaches,
techniques based on stability analyze the training dynamics and derive
algorithm-dependent generalization bounds. Unfortunately, the stability-based
bounds are still far from explaining the surprising generalization in deep
learning since neural networks usually suffer from unsatisfactory stability.
This paper proposes a novel decomposition framework to improve the
stability-based bounds via a more fine-grained analysis of the signal and
noise, inspired by the observation that neural networks converge relatively
slowly when fitting noise (which indicates better stability). Concretely, we
decompose the excess risk dynamics and apply the stability-based bound only on
the noise component. The decomposition framework performs well in both linear
regimes (overparameterized linear regression) and non-linear regimes (diagonal
matrix recovery). Experiments on neural networks verify the utility of the
decomposition framework.

27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess