Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Can LSTM Learn to Capture Agreement? The Case of Basque   Sequential neural networks models are powerful tools in a variety of Natural
Language Processing (NLP) tasks. The sequential nature of these models raises
the questions: to what extent can these models implicitly learn hierarchical
structures typical to human language, and what kind of grammatical phenomena
can they acquire?
  We focus on the task of agreement prediction in Basque, as a case study for a
task that requires implicit understanding of sentence structure and the
acquisition of a complex but consistent morphological system. Analyzing
experimental results from two syntactic prediction tasks -- verb number
prediction and suffix recovery -- we find that sequential models perform worse
on agreement prediction in Basque than one might expect on the basis of a
previous agreement prediction work in English. Tentative findings based on
diagnostic classifiers suggest the network makes use of local heuristics as a
proxy for the hierarchical structure of the sentence. We propose the Basque
agreement prediction task as challenging benchmark for models that attempt to
learn regularities in human language.

34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
3
The categories of this paper are: physics
2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin