Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled
  Images   We present BlockGAN, an image generative model that learns object-aware 3D
scene representations directly from unlabelled 2D images. Current work on scene
representation learning either ignores scene background or treats the whole
scene as one object. Meanwhile, work that considers scene compositionality
treats scene objects only as image patches or 2D layers with alpha maps.
Inspired by the computer graphics pipeline, we design BlockGAN to learn to
first generate 3D features of background and foreground objects, then combine
them into 3D features for the wholes cene, and finally render them into
realistic images. This allows BlockGAN to reason over occlusion and interaction
between objects' appearance, such as shadow and lighting, and provides control
over each object's 3D pose and identity, while maintaining image realism.
BlockGAN is trained end-to-end, using only unlabelled single images, without
the need for 3D geometry, pose labels, object masks, or multiple views of the
same scene. Our experiments show that using explicit 3D features to represent
objects allows BlockGAN to learn disentangled representations both in terms of
objects (foreground and background) and their properties (pose and identity).

15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn
5
The categories of this paper are: gr-qc
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
18
The categories of this paper are: econ
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg