Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Hierarchical Text-Conditional Image Generation with CLIP Latents   Contrastive models like CLIP have been shown to learn robust representations
of images that capture both semantics and style. To leverage these
representations for image generation, we propose a two-stage model: a prior
that generates a CLIP image embedding given a text caption, and a decoder that
generates an image conditioned on the image embedding. We show that explicitly
generating image representations improves image diversity with minimal loss in
photorealism and caption similarity. Our decoders conditioned on image
representations can also produce variations of an image that preserve both its
semantics and style, while varying the non-essential details absent from the
image representation. Moreover, the joint embedding space of CLIP enables
language-guided image manipulations in a zero-shot fashion. We use diffusion
models for the decoder and experiment with both autoregressive and diffusion
models for the prior, finding that the latter are computationally more
efficient and produce higher-quality samples.

11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
29
The categories of this paper are: funct-an