Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Backpropagation through nonlinear units for all-optical training of
  neural networks   Backpropagation through nonlinear neurons is an outstanding challenge to the
field of optical neural networks and the major conceptual barrier to
all-optical training schemes. Each neuron is required to exhibit a
directionally dependent response to propagating optical signals, with the
backwards response conditioned on the forward signal, which is highly
non-trivial to implement optically. We propose a practical and surprisingly
simple solution that uses saturable absorption to provide the network
nonlinearity. We find that the backward propagating gradients required to train
the network can be approximated in a pump-probe scheme that requires only
passive optical elements. Simulations show that, with readily obtainable
optical depths, our approach can achieve equivalent performance to
state-of-the-art computational networks on image classification benchmarks,
even in deep networks with multiple sequential gradient approximations. This
scheme is compatible with leading optical neural network proposals and
therefore provides a feasible path towards end-to-end optical training.

20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
26
The categories of this paper are: bayes-an
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
35
The categories of this paper are: mtrl-th