Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Searching Intrinsic Dimensions of Vision Transformers   It has been shown by many researchers that transformers perform as well as
convolutional neural networks in many computer vision tasks. Meanwhile, the
large computational costs of its attention module hinder further studies and
applications on edge devices. Some pruning methods have been developed to
construct efficient vision transformers, but most of them have considered image
classification tasks only. Inspired by these results, we propose SiDT, a method
for pruning vision transformer backbones on more complicated vision tasks like
object detection, based on the search of transformer dimensions. Experiments on
CIFAR-100 and COCO datasets show that the backbones with 20\% or 40\%
dimensions/parameters pruned can have similar or even better performance than
the unpruned models. Moreover, we have also provided the complexity analysis
and comparisons with the previous pruning methods.

4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio