Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AutoML-Zero: Evolving Machine Learning Algorithms From Scratch   Machine learning research has advanced in multiple aspects, including model
structures and learning methods. The effort to automate such research, known as
AutoML, has also made significant progress. However, this progress has largely
focused on the architecture of neural networks, where it has relied on
sophisticated expert-designed layers as building blocks---or similarly
restrictive search spaces. Our goal is to show that AutoML can go further: it
is possible today to automatically discover complete machine learning
algorithms just using basic mathematical operations as building blocks. We
demonstrate this by introducing a novel framework that significantly reduces
human bias through a generic search space. Despite the vastness of this space,
evolutionary search can still discover two-layer neural networks trained by
backpropagation. These simple neural networks can then be surpassed by evolving
directly on tasks of interest, e.g. CIFAR-10 variants, where modern techniques
emerge in the top algorithms, such as bilinear interactions, normalized
gradients, and weight averaging. Moreover, evolution adapts algorithms to
different task types: e.g., dropout-like techniques appear when little data is
available. We believe these preliminary successes in discovering machine
learning algorithms from scratch indicate a promising new direction for the
field.

35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
33
The categories of this paper are: plasm-ph