Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Sober Look at the Unsupervised Learning of Disentangled
  Representations and their Evaluation   The idea behind the \emph{unsupervised} learning of \emph{disentangled}
representations is that real-world data is generated by a few explanatory
factors of variation which can be recovered by unsupervised learning
algorithms. In this paper, we provide a sober look at recent progress in the
field and challenge some common assumptions. We first theoretically show that
the unsupervised learning of disentangled representations is fundamentally
impossible without inductive biases on both the models and the data. Then, we
train over $14000$ models covering most prominent methods and evaluation
metrics in a reproducible large-scale experimental study on eight data sets. We
observe that while the different methods successfully enforce properties
"encouraged" by the corresponding losses, well-disentangled models seemingly
cannot be identified without supervision. Furthermore, different evaluation
metrics do not always agree on what should be considered "disentangled" and
exhibit systematic differences in the estimation. Finally, increased
disentanglement does not seem to necessarily lead to a decreased sample
complexity of learning for downstream tasks. Our results suggest that future
work on disentanglement learning should be explicit about the role of inductive
biases and (implicit) supervision, investigate concrete benefits of enforcing
disentanglement of the learned representations, and consider a reproducible
experimental setup covering several data sets.

0
The categories of this paper are: hep-ph
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg