Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via
  Crowdsourcing   We present LEGOEval, an open-source toolkit that enables researchers to
easily evaluate dialogue systems in a few lines of code using the online
crowdsource platform, Amazon Mechanical Turk. Compared to existing toolkits,
LEGOEval features a flexible task design by providing a Python API that maps to
commonly used React.js interface components. Researchers can personalize their
evaluation procedures easily with our built-in pages as if playing with LEGO
blocks. Thus, LEGOEval provides a fast, consistent method for reproducing human
evaluation results. Besides the flexible task design, LEGOEval also offers an
easy API to review collected data.

17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
19
The categories of this paper are: eess
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
16
The categories of this paper are: stat