Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: High Dimensional Optimization through the Lens of Machine Learning   This thesis reviews numerical optimization methods with machine learning
problems in mind. Since machine learning models are highly parametrized, we
focus on methods suited for high dimensional optimization. We build intuition
on quadratic models to figure out which methods are suited for non-convex
optimization, and develop convergence proofs on convex functions for this
selection of methods. With this theoretical foundation for stochastic gradient
descent and momentum methods, we try to explain why the methods used commonly
in the machine learning field are so successful. Besides explaining successful
heuristics, the last chapter also provides a less extensive review of more
theoretical methods, which are not quite as popular in practice. So in some
sense this work attempts to answer the question: Why are the default Tensorflow
optimizers included in the defaults?

33
The categories of this paper are: plasm-ph
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin