Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image
  Captioning   Popular metrics used for evaluating image captioning systems, such as BLEU
and CIDEr, provide a single score to gauge the system's overall effectiveness.
This score is often not informative enough to indicate what specific errors are
made by a given system. In this study, we present a fine-grained evaluation
method REO for automatically measuring the performance of image captioning
systems. REO assesses the quality of captions from three perspectives: 1)
Relevance to the ground truth, 2) Extraness of the content that is irrelevant
to the ground truth, and 3) Omission of the elements in the images and human
references. Experiments on three benchmark datasets demonstrate that our method
achieves a higher consistency with human judgments and provides more intuitive
evaluation results than alternative metrics.

30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th