Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Disentangling Latent Space for VAE by Label Relevant/Irrelevant
  Dimensions   VAE requires the standard Gaussian distribution as a prior in the latent
space. Since all codes tend to follow the same prior, it often suffers the
so-called "posterior collapse". To avoid this, this paper introduces the class
specific distribution for the latent code. But different from CVAE, we present
a method for disentangling the latent space into the label relevant and
irrelevant dimensions, $\bm{\mathrm{z}}_s$ and $\bm{\mathrm{z}}_u$, for a
single input. We apply two separated encoders to map the input into
$\bm{\mathrm{z}}_s$ and $\bm{\mathrm{z}}_u$ respectively, and then give the
concatenated code to the decoder to reconstruct the input. The label irrelevant
code $\bm{\mathrm{z}}_u$ represent the common characteristics of all inputs,
hence they are constrained by the standard Gaussian, and their encoder is
trained in amortized variational inference way, like VAE. While
$\bm{\mathrm{z}}_s$ is assumed to follow the Gaussian mixture distribution in
which each component corresponds to a particular class. The parameters for the
Gaussian components in $\bm{\mathrm{z}}_s$ encoder are optimized by the label
supervision in a global stochastic way. In theory, we show that our method is
actually equivalent to adding a KL divergence term on the joint distribution of
$\bm{\mathrm{z}}_s$ and the class label $c$, and it can directly increase the
mutual information between $\bm{\mathrm{z}}_s$ and the label $c$. Our model can
also be extended to GAN by adding a discriminator in the pixel domain so that
it produces high quality and diverse images.

23
The categories of this paper are: solv-int
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th