Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Controlling Style and Semantics in Weakly-Supervised Image Generation   We propose a weakly-supervised approach for conditional image generation of
complex scenes where a user has fine control over objects appearing in the
scene. We exploit sparse semantic maps to control object shapes and classes, as
well as textual descriptions or attributes to control both local and global
style. In order to condition our model on textual descriptions, we introduce a
semantic attention module whose computational cost is independent of the image
resolution. To further augment the controllability of the scene, we propose a
two-step generation scheme that decomposes background and foreground. The label
maps used to train our model are produced by a large-vocabulary object
detector, which enables access to unlabeled data and provides structured
instance information. In such a setting, we report better FID scores compared
to fully-supervised settings where the model is trained on ground-truth
semantic maps. We also showcase the ability of our model to manipulate a scene
on complex datasets such as COCO and Visual Genome.

6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg