Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Accelerated Methods in Optimization   In convex optimization, there is an {\em acceleration} phenomenon in which we
can boost the convergence rate of certain gradient-based algorithms. We can
observe this phenomenon in Nesterov's accelerated gradient descent, accelerated
mirror descent, and accelerated cubic-regularized Newton's method, among
others. In this paper, we show that the family of higher-order gradient methods
in discrete time (generalizing gradient descent) corresponds to a family of
first-order rescaled gradient flows in continuous time. On the other hand, the
family of {\em accelerated} higher-order gradient methods (generalizing
accelerated mirror descent) corresponds to a family of second-order
differential equations in continuous time, each of which is the Euler-Lagrange
equation of a family of Lagrangian functionals. We also study the exponential
variant of the Nesterov Lagrangian, which corresponds to a generalization of
Nesterov's restart scheme and achieves a linear rate of convergence in discrete
time. Finally, we show that the family of Lagrangians is closed under time
dilation (an orbit under the action of speeding up time), which demonstrates
the universality of this Lagrangian view of acceleration in optimization.

16
The categories of this paper are: stat
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
3
The categories of this paper are: physics
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph