Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evaluating Dialogue Generation Systems via Response Selection   Existing automatic evaluation metrics for open-domain dialogue response
generation systems correlate poorly with human evaluation. We focus on
evaluating response generation systems via response selection. To evaluate
systems properly via response selection, we propose the method to construct
response selection test sets with well-chosen false candidates. Specifically,
we propose to construct test sets filtering out some types of false candidates:
(i) those unrelated to the ground-truth response and (ii) those acceptable as
appropriate responses. Through experiments, we demonstrate that evaluating
systems via response selection with the test sets developed by our method
correlates more strongly with human evaluation, compared with widely used
automatic evaluation metrics such as BLEU.

6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
2
The categories of this paper are: math
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat