Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption
  Evaluation via Typicality Analysis   The open-ended nature of visual captioning makes it a challenging area for
evaluation. The majority of proposed models rely on specialized training to
improve human-correlation, resulting in limited adoption, generalizability, and
explainabilty. We introduce "typicality", a new formulation of evaluation
rooted in information theory, which is uniquely suited for problems lacking a
definite ground truth. Typicality serves as our framework to develop a novel
semantic comparison, SPARCS, as well as referenceless fluency evaluation
metrics. Over the course of our analysis, two separate dimensions of fluency
naturally emerge: style, captured by metric SPURTS, and grammar, captured in
the form of grammatical outlier penalties. Through extensive experiments and
ablation studies on benchmark datasets, we show how these decomposed dimensions
of semantics and fluency provide greater system-level insight into captioner
differences. Our proposed metrics along with their combination, SMURF, achieve
state-of-the-art correlation with human judgment when compared with other
rule-based evaluation metrics.

32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci