Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dynamic Runtime Feature Map Pruning   High bandwidth requirements are an obstacle for accelerating the training and
inference of deep neural networks. Most previous research focuses on reducing
the size of kernel maps for inference. We analyze parameter sparsity of six
popular convolutional neural networks - AlexNet, MobileNet, ResNet-50,
SqueezeNet, TinyNet, and VGG16. Of the networks considered, those using ReLU
(AlexNet, SqueezeNet, VGG16) contain a high percentage of 0-valued parameters
and can be statically pruned. Networks with Non-ReLU activation functions in
some cases may not contain any 0-valued parameters (ResNet-50, TinyNet). We
also investigate runtime feature map usage and find that input feature maps
comprise the majority of bandwidth requirements when depth-wise convolution and
point-wise convolutions used. We introduce dynamic runtime pruning of feature
maps and show that 10% of dynamic feature map execution can be removed without
loss of accuracy. We then extend dynamic pruning to allow for values within an
epsilon of zero and show a further 5% reduction of feature map loading with a
1% loss of accuracy in top-1.

3
The categories of this paper are: physics
9
The categories of this paper are: nlin
18
The categories of this paper are: econ
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys