Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reparameterization trick for discrete variables   Low-variance gradient estimation is crucial for learning directed graphical
models parameterized by neural networks, where the reparameterization trick is
widely used for those with continuous variables. While this technique gives
low-variance gradient estimates, it has not been directly applicable to
discrete variables, the sampling of which inherently requires discontinuous
operations. We argue that the discontinuity can be bypassed by marginalizing
out the variable of interest, which results in a new reparameterization trick
for discrete variables. This reparameterization greatly reduces the variance,
which is understood by regarding the method as an application of common random
numbers to the estimation. The resulting estimator is theoretically guaranteed
to have a variance not larger than that of the likelihood-ratio method with the
optimal input-dependent baseline. We give empirical results for variational
learning of sigmoid belief networks.

37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio