Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dense Captioning with Joint Inference and Visual Context   Dense captioning is a newly emerging computer vision topic for understanding
images with dense language descriptions. The goal is to densely detect visual
concepts (e.g., objects, object parts, and interactions between them) from
images, labeling each with a short descriptive phrase. We identify two key
challenges of dense captioning that need to be properly addressed when tackling
the problem. First, dense visual concept annotations in each image are
associated with highly overlapping target regions, making accurate localization
of each visual concept challenging. Second, the large amount of visual concepts
makes it hard to recognize each of them by appearance alone. We propose a new
model pipeline based on two novel ideas, joint inference and context fusion, to
alleviate these two challenges. We design our model architecture in a
methodical manner and thoroughly evaluate the variations in architecture. Our
final model, compact and efficient, achieves state-of-the-art accuracy on
Visual Genome for dense captioning with a relative gain of 73\% compared to the
previous best algorithm. Qualitative experiments also reveal the semantic
capabilities of our model in dense captioning.

22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio