Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Does It Make Sense? And Why? A Pilot Study for Sense Making and
  Explanation   Introducing common sense to natural language understanding systems has
received increasing research attention. It remains a fundamental question on
how to evaluate whether a system has a sense making capability. Existing
benchmarks measures commonsense knowledge indirectly and without explanation.
In this paper, we release a benchmark to directly test whether a system can
differentiate natural language statements that make sense from those that do
not make sense. In addition, a system is asked to identify the most crucial
reason why a statement does not make sense. We evaluate models trained over
large-scale language modeling tasks as well as human performance, showing that
there are different challenges for system sense making.

34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int