Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Character Matters: Video Story Understanding with Character-Aware
  Relations   Different from short videos and GIFs, video stories contain clear plots and
lists of principal characters. Without identifying the connection between
appearing people and character names, a model is not able to obtain a genuine
understanding of the plots. Video Story Question Answering (VSQA) offers an
effective way to benchmark higher-level comprehension abilities of a model.
However, current VSQA methods merely extract generic visual features from a
scene. With such an approach, they remain prone to learning just superficial
correlations. In order to attain a genuine understanding of who did what to
whom, we propose a novel model that continuously refines character-aware
relations. This model specifically considers the characters in a video story,
as well as the relations connecting different characters and objects. Based on
these signals, our framework enables weakly-supervised face naming through
multi-instance co-occurrence matching and supports high-level reasoning
utilizing Transformer structures. We train and test our model on the six
diverse TV shows in the TVQA dataset, which is by far the largest and only
publicly available dataset for VSQA. We validate our proposed approach over
TVQA dataset through extensive ablation study.

23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
2
The categories of this paper are: math
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
29
The categories of this paper are: funct-an
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th