Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Relating by Contrasting: A Data-efficient Framework for Multimodal
  Generative Models   Multimodal learning for generative models often refers to the learning of
abstract concepts from the commonality of information in multiple modalities,
such as vision and language. While it has proven effective for learning
generalisable representations, the training of such models often requires a
large amount of "related" multimodal data that shares commonality, which can be
expensive to come by. To mitigate this, we develop a novel contrastive
framework for generative model learning, allowing us to train the model not
just by the commonality between modalities, but by the distinction between
"related" and "unrelated" multimodal data. We show in experiments that our
method enables data-efficient multimodal learning on challenging datasets for
various multimodal VAE models. We also show that under our proposed framework,
the generative model can accurately identify related samples from unrelated
ones, making it possible to make use of the plentiful unlabeled, unpaired
multimodal data.

19
The categories of this paper are: eess
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org