Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Video Captioning with Boundary-aware Hierarchical Language Decoding and
  Joint Video Prediction   The explosion of video data on the internet requires effective and efficient
technology to generate captions automatically for people who are not able to
watch the videos. Despite the great progress of video captioning research,
particularly on video feature encoding, the language decoder is still largely
based on the prevailing RNN decoder such as LSTM, which tends to prefer the
frequent word that aligns with the video. In this paper, we propose a
boundary-aware hierarchical language decoder for video captioning, which
consists of a high-level GRU based language decoder, working as a global
(caption-level) language model, and a low-level GRU based language decoder,
working as a local (phrase-level) language model. Most importantly, we
introduce a binary gate into the low-level GRU language decoder to detect the
language boundaries. Together with other advanced components including joint
video prediction, shared soft attention, and boundary-aware video encoding, our
integrated video captioning framework can discover hierarchical language
information and distinguish the subject and the object in a sentence, which are
usually confusing during the language generation. Extensive experiments on two
widely-used video captioning datasets, MSR-Video-to-Text (MSR-VTT)
\cite{xu2016msr} and YouTube-to-Text (MSVD) \cite{chen2011collecting} show that
our method is highly competitive, compared with the state-of-the-art methods.

31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph