Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: End-to-end Image Captioning Exploits Multimodal Distributional
  Similarity   We hypothesize that end-to-end neural image captioning systems work seemingly
well because they exploit and learn `distributional similarity' in a multimodal
feature space by mapping a test image to similar training images in this space
and generating a caption from the same space. To validate our hypothesis, we
focus on the `image' side of image captioning, and vary the input image
representation but keep the RNN text generation component of a CNN-RNN model
constant. Our analysis indicates that image captioning models (i) are capable
of separating structure from noisy input representations; (ii) suffer virtually
no significant performance loss when a high dimensional representation is
compressed to a lower dimensional space; (iii) cluster images with similar
visual and linguistic information together. Our findings indicate that our
distributional similarity hypothesis holds. We conclude that regardless of the
image representation used image captioning systems seem to match images and
generate captions in a learned joint image-text semantic subspace.

17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin