Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: BERT Rediscovers the Classical NLP Pipeline   Pre-trained text encoders have rapidly advanced the state of the art on many
NLP tasks. We focus on one such model, BERT, and aim to quantify where
linguistic information is captured within the network. We find that the model
represents the steps of the traditional NLP pipeline in an interpretable and
localizable way, and that the regions responsible for each step appear in the
expected sequence: POS tagging, parsing, NER, semantic roles, then coreference.
Qualitative analysis reveals that the model can and often does adjust this
pipeline dynamically, revising lower-level decisions on the basis of
disambiguating information from higher-level representations.

11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom