Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Revisiting Normalized Gradient Descent: Fast Evasion of Saddle Points   The note considers normalized gradient descent (NGD), a natural modification
of classical gradient descent (GD) in optimization problems. A serious
shortcoming of GD in non-convex problems is that GD may take arbitrarily long
to escape from the neighborhood of a saddle point. This issue can make the
convergence of GD arbitrarily slow, particularly in high-dimensional non-convex
problems where the relative number of saddle points is often large. The paper
focuses on continuous-time descent. It is shown that, contrary to standard GD,
NGD escapes saddle points `quickly.' In particular, it is shown that (i) NGD
`almost never' converges to saddle points and (ii) the time required for NGD to
escape from a ball of radius $r$ about a saddle point $x^*$ is at most
$5\sqrt{\kappa}r$, where $\kappa$ is the condition number of the Hessian of $f$
at $x^*$. As an application of this result, a global convergence-time bound is
established for NGD under mild assumptions.

16
The categories of this paper are: stat
9
The categories of this paper are: nlin
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics