Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Searching for Stage-wise Neural Graphs In the Limit   Search space is a key consideration for neural architecture search. Recently,
Xie et al. (2019) found that randomly generated networks from the same
distribution perform similarly, which suggests we should search for random
graph distributions instead of graphs. We propose graphon as a new search
space. A graphon is the limit of Cauchy sequence of graphs and a scale-free
probabilistic distribution, from which graphs of different number of nodes can
be drawn. By utilizing properties of the graphon space and the associated
cut-distance metric, we develop theoretically motivated techniques that search
for and scale up small-capacity stage-wise graphs found on small datasets to
large-capacity graphs that can handle ImageNet. The scaled stage-wise graphs
outperform DenseNet and randomly wired Watts-Strogatz networks, indicating the
benefits of graphon theory in NAS applications.

19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph
2
The categories of this paper are: math