Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Recombination of Artificial Neural Networks   We propose a genetic algorithm (GA) for hyperparameter optimization of
artificial neural networks which includes chromosomal crossover as well as a
decoupling of parameters (i.e., weights and biases) from hyperparameters (e.g.,
learning rate, weight decay, and dropout) during sexual reproduction. Children
are produced from three parents; two contributing hyperparameters and one
contributing the parameters. Our version of population-based training (PBT)
combines traditional gradient-based approaches such as stochastic gradient
descent (SGD) with our GA to optimize both parameters and hyperparameters
across SGD epochs. Our improvements over traditional PBT provide an increased
speed of adaptation and a greater ability to shed deleterious genes from the
population. Our methods improve final accuracy as well as time to fixed
accuracy on a wide range of deep neural network architectures including
convolutional neural networks, recurrent neural networks, dense neural
networks, and capsule networks.

24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg