Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Broad Context Language Modeling as Reading Comprehension   Progress in text understanding has been driven by large datasets that test
particular capabilities, like recent datasets for reading comprehension
(Hermann et al., 2015). We focus here on the LAMBADA dataset (Paperno et al.,
2016), a word prediction task requiring broader context than the immediate
sentence. We view LAMBADA as a reading comprehension problem and apply
comprehension models based on neural networks. Though these models are
constrained to choose a word from the context, they improve the state of the
art on LAMBADA from 7.3% to 49%. We analyze 100 instances, finding that neural
network readers perform well in cases that involve selecting a name from the
context based on dialogue or discourse cues but struggle when coreference
resolution or external knowledge is needed.

14
The categories of this paper are: math-ph
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th