Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learnable Embedding Space for Efficient Neural Architecture Compression   We propose a method to incrementally learn an embedding space over the domain
of network architectures, to enable the careful selection of architectures for
evaluation during compressed architecture search. Given a teacher network, we
search for a compressed network architecture by using Bayesian Optimization
(BO) with a kernel function defined over our proposed embedding space to select
architectures for evaluation. We demonstrate that our search algorithm can
significantly outperform various baseline methods, such as random search and
reinforcement learning (Ashok et al., 2018). The compressed architectures found
by our method are also better than the state-of-the-art manually-designed
compact architecture ShuffleNet (Zhang et al., 2018). We also demonstrate that
the learned embedding space can be transferred to new settings for architecture
search, such as a larger teacher network or a teacher network in a different
architecture family, without any training. Code is publicly available here:
https://github.com/Friedrich1006/ESNAC .

7
The categories of this paper are: hep-th
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
37
The categories of this paper are: supr-con