Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Partition Functions from Rao-Blackwellized Tempered Sampling   Partition functions of probability distributions are important quantities for
model evaluation and comparisons. We present a new method to compute partition
functions of complex and multimodal distributions. Such distributions are often
sampled using simulated tempering, which augments the target space with an
auxiliary inverse temperature variable. Our method exploits the multinomial
probability law of the inverse temperatures, and provides estimates of the
partition function in terms of a simple quotient of Rao-Blackwellized marginal
inverse temperature probability estimates, which are updated while sampling. We
show that the method has interesting connections with several alternative
popular methods, and offers some significant advantages. In particular, we
empirically find that the new method provides more accurate estimates than
Annealed Importance Sampling when calculating partition functions of large
Restricted Boltzmann Machines (RBM); moreover, the method is sufficiently
accurate to track training and validation log-likelihoods during learning of
RBMs, at minimal computational cost.

28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
3
The categories of this paper are: physics
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin