Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Rethinking the Form of Latent States in Image Captioning   RNNs and their variants have been widely adopted for image captioning. In
RNNs, the production of a caption is driven by a sequence of latent states.
Existing captioning models usually represent latent states as vectors, taking
this practice for granted. We rethink this choice and study an alternative
formulation, namely using two-dimensional maps to encode latent states. This is
motivated by the curiosity about a question: how the spatial structures in the
latent states affect the resultant captions? Our study on MSCOCO and Flickr30k
leads to two significant observations. First, the formulation with 2D states is
generally more effective in captioning, consistently achieving higher
performance with comparable parameter sizes. Second, 2D states preserve spatial
locality. Taking advantage of this, we visually reveal the internal dynamics in
the process of caption generation, as well as the connections between input
visual domain and output linguistic domain.

35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex