Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Spurious Correlations in Reference-Free Evaluation of Text Generation   Model-based, reference-free evaluation metrics have been proposed as a fast
and cost-effective approach to evaluate Natural Language Generation (NLG)
systems. Despite promising recent results, we find evidence that reference-free
evaluation metrics of summarization and dialog generation may be relying on
spurious correlations with measures such as word overlap, perplexity, and
length. We further observe that for text summarization, these metrics have high
error rates when ranking current state-of-the-art abstractive summarization
systems. We demonstrate that these errors can be mitigated by explicitly
designing evaluation metrics to avoid spurious features in reference-free
evaluation.

31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int