Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: RadiX-Net: Structured Sparse Matrices for Deep Neural Networks   The sizes of deep neural networks (DNNs) are rapidly outgrowing the capacity
of hardware to store and train them. Research over the past few decades has
explored the prospect of sparsifying DNNs before, during, and after training by
pruning edges from the underlying topology. The resulting neural network is
known as a sparse neural network. More recent work has demonstrated the
remarkable result that certain sparse DNNs can train to the same precision as
dense DNNs at lower runtime and storage cost. An intriguing class of these
sparse DNNs is the X-Nets, which are initialized and trained upon a sparse
topology with neither reference to a parent dense DNN nor subsequent pruning.
We present an algorithm that deterministically generates RadiX-Nets: sparse DNN
topologies that, as a whole, are much more diverse than X-Net topologies, while
preserving X-Nets' desired characteristics. We further present a
functional-analytic conjecture based on the longstanding observation that
sparse neural network topologies can attain the same expressive power as dense
counterparts

34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
2
The categories of this paper are: math