Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Refined $\alpha$-Divergence Variational Inference via Rejection Sampling   We present an approximate inference method, based on a synergistic
combination of R\'enyi $\alpha$-divergence variational inference (RDVI) and
rejection sampling (RS). RDVI is based on minimization of R\'enyi
$\alpha$-divergence $D_\alpha(p||q)$ between the true distribution $p(x)$ and a
variational approximation $q(x)$; RS draws samples from a distribution $p(x) =
\tilde{p}(x)/Z_{p}$ using a proposal $q(x)$, s.t. $Mq(x) \geq \tilde{p}(x),
\forall x$. Our inference method is based on a crucial observation that
$D_\infty(p||q)$ equals $\log M(\theta)$ where $M(\theta)$ is the optimal value
of the RS constant for a given proposal $q_\theta(x)$. This enables us to
develop a \emph{two-stage} hybrid inference algorithm. Stage-1 performs RDVI to
learn $q_\theta$ by minimizing an estimator of $D_\alpha(p||q)$, and uses the
learned $q_\theta$ to find an (approximately) optimal $\tilde{M}(\theta)$.
Stage-2 performs RS using the constant $\tilde{M}(\theta)$ to improve the
approximate distribution $q_\theta$ and obtain a sample-based approximation. We
prove that this two-stage method allows us to learn considerably more accurate
approximations of the target distribution as compared to RDVI. We demonstrate
our method's efficacy via several experiments on synthetic and real datasets.

8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
20
The categories of this paper are: acc-phys
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
9
The categories of this paper are: nlin