Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep ReLU Programming   Feed-forward ReLU neural networks partition their input domain into finitely
many "affine regions" of constant neuron activation pattern and affine
behaviour. We analyze their mathematical structure and provide algorithmic
primitives for an efficient application of linear programming related
techniques for iterative minimization of such non-convex functions. In
particular, we propose an extension of the Simplex algorithm which is iterating
on induced vertices but, in addition, is able to change its feasible region
computationally efficiently to adjacent "affine regions". This way, we obtain
the Barrodale-Roberts algorithm for LAD regression as a special case, but also
are able to train the first layer of neural networks with L1 training loss
decreasing in every step.

29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th