Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Commonsense Question Answering by Graph-based Iterative
  Retrieval over Multiple Knowledge Sources   In order to facilitate natural language understanding, the key is to engage
commonsense or background knowledge. However, how to engage commonsense
effectively in question answering systems is still under exploration in both
research academia and industry. In this paper, we propose a novel
question-answering method by integrating multiple knowledge sources, i.e.
ConceptNet, Wikipedia, and the Cambridge Dictionary, to boost the performance.
More concretely, we first introduce a novel graph-based iterative knowledge
retrieval module, which iteratively retrieves concepts and entities related to
the given question and its choices from multiple knowledge sources. Afterward,
we use a pre-trained language model to encode the question, retrieved knowledge
and choices, and propose an answer choice-aware attention mechanism to fuse all
hidden representations of the previous modules. Finally, the linear classifier
for specific tasks is used to predict the answer. Experimental results on the
CommonsenseQA dataset show that our method significantly outperforms other
competitive methods and achieves the new state-of-the-art. In addition, further
ablation studies demonstrate the effectiveness of our graph-based iterative
knowledge retrieval module and the answer choice-aware attention module in
retrieving and synthesizing background knowledge from multiple knowledge
sources.

33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas