Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scalable Training of Artificial Neural Networks with Adaptive Sparse
  Connectivity inspired by Network Science   Through the success of deep learning in various domains, artificial neural
networks are currently among the most used artificial intelligence methods.
Taking inspiration from the network properties of biological neural networks
(e.g. sparsity, scale-freeness), we argue that (contrary to general practice)
artificial neural networks, too, should not have fully-connected layers. Here
we propose sparse evolutionary training of artificial neural networks, an
algorithm which evolves an initial sparse topology (Erd\H{o}s-R\'enyi random
graph) of two consecutive layers of neurons into a scale-free topology, during
learning. Our method replaces artificial neural networks fully-connected layers
with sparse ones before training, reducing quadratically the number of
parameters, with no decrease in accuracy. We demonstrate our claims on
restricted Boltzmann machines, multi-layer perceptrons, and convolutional
neural networks for unsupervised and supervised learning on 15 datasets. Our
approach has the potential to enable artificial neural networks to scale up
beyond what is currently possible.

35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an