Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Information-Theoretic Generalization Bounds for SGLD via Data-Dependent
  Estimates   In this work, we improve upon the stepwise analysis of noisy iterative
learning algorithms initiated by Pensia, Jog, and Loh (2018) and recently
extended by Bu, Zou, and Veeravalli (2019). Our main contributions are
significantly improved mutual information bounds for Stochastic Gradient
Langevin Dynamics via data-dependent estimates. Our approach is based on the
variational characterization of mutual information and the use of
data-dependent priors that forecast the mini-batch gradient based on a subset
of the training samples. Our approach is broadly applicable within the
information-theoretic framework of Russo and Zou (2015) and Xu and Raginsky
(2017). Our bound can be tied to a measure of flatness of the empirical risk
surface. As compared with other bounds that depend on the squared norms of
gradients, empirical investigations show that the terms in our bounds are
orders of magnitude smaller.

21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex