Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Discovery of Natural Language Concepts in Individual Units of CNNs   Although deep convolutional networks have achieved improved performance in
many natural language tasks, they have been treated as black boxes because they
are difficult to interpret. Especially, little is known about how they
represent language in their intermediate layers. In an attempt to understand
the representations of deep convolutional networks trained on language tasks,
we show that individual units are selectively responsive to specific morphemes,
words, and phrases, rather than responding to arbitrary and uninterpretable
patterns. In order to quantitatively analyze such an intriguing phenomenon, we
propose a concept alignment method based on how units respond to the replicated
text. We conduct analyses with different architectures on multiple datasets for
classification and translation tasks and provide new insights into how deep
models understand natural language.

32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
23
The categories of this paper are: solv-int
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin