Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Predicting distributions with Linearizing Belief Networks   Conditional belief networks introduce stochastic binary variables in neural
networks. Contrary to a classical neural network, a belief network can predict
more than the expected value of the output $Y$ given the input $X$. It can
predict a distribution of outputs $Y$ which is useful when an input can admit
multiple outputs whose average is not necessarily a valid answer. Such networks
are particularly relevant to inverse problems such as image prediction for
denoising, or text to speech. However, traditional sigmoid belief networks are
hard to train and are not suited to continuous problems. This work introduces a
new family of networks called linearizing belief nets or LBNs. A LBN decomposes
into a deep linear network where each linear unit can be turned on or off by
non-deterministic binary latent units. It is a universal approximator of
real-valued conditional distributions and can be trained using gradient
descent. Moreover, the linear pathways efficiently propagate continuous
information and they act as multiplicative skip-connections that help
optimization by removing gradient diffusion. This yields a model which trains
efficiently and improves the state-of-the-art on image denoising and facial
expression generation with the Toronto faces dataset.

29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
33
The categories of this paper are: plasm-ph
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
16
The categories of this paper are: stat
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th