Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: To lemmatize or not to lemmatize: how word normalisation affects ELMo
  performance in word sense disambiguation   We critically evaluate the widespread assumption that deep learning NLP
models do not require lemmatized input. To test this, we trained versions of
contextualised word embedding ELMo models on raw tokenized corpora and on the
corpora with word tokens replaced by their lemmas. Then, these models were
evaluated on the word sense disambiguation task. This was done for the English
and Russian languages.
  The experiments showed that while lemmatization is indeed not necessary for
English, the situation is different for Russian. It seems that for
rich-morphology languages, using lemmatized training and testing data yields
small but consistent improvements: at least for word sense disambiguation. This
means that the decisions about text pre-processing before training ELMo should
consider the linguistic nature of the language in question.

30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat