Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exposition and Interpretation of the Topology of Neural Networks   Convolutional neural networks (CNN's) are powerful and widely used tools.
However, their interpretability is far from ideal. One such shortcoming is the
difficulty of deducing a network's ability to generalize to unseen data. We use
topological data analysis to show that the information encoded in the weights
of a CNN can be organized in terms of a topological data model and demonstrate
how such information can be interpreted and utilized. We show that the weights
of convolutional layers at depths from 1 through 13 learn simple global
structures. We also demonstrate the change of the simple structures over the
course of training. In particular, we define and analyze the spaces of spatial
filters of convolutional layers and show the recurrence, among all networks,
depths, and during training, of a simple circle consisting of rotating edges,
as well as a less recurring unanticipated complex circle that combines lines,
edges, and non-linear patterns. We also demonstrate that topological structure
correlates with a network's ability to generalize to unseen data and that
topological information can be used to improve a network's performance. We
train over a thousand CNN's on MNIST, CIFAR-10, SVHN, and ImageNet.

33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
25
The categories of this paper are: patt-sol
6
The categories of this paper are: astro-ph