Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Second-Order Non-Stationary Online Learning for Regression   The goal of a learner, in standard online learning, is to have the cumulative
loss not much larger compared with the best-performing function from some fixed
class. Numerous algorithms were shown to have this gap arbitrarily close to
zero, compared with the best function that is chosen off-line. Nevertheless,
many real-world applications, such as adaptive filtering, are non-stationary in
nature, and the best prediction function may drift over time. We introduce two
novel algorithms for online regression, designed to work well in non-stationary
environment. Our first algorithm performs adaptive resets to forget the
history, while the second is last-step min-max optimal in context of a drift.
We analyze both algorithms in the worst-case regret framework and show that
they maintain an average loss close to that of the best slowly changing
sequence of linear functions, as long as the cumulative drift is sublinear. In
addition, in the stationary case, when no drift occurs, our algorithms suffer
logarithmic regret, as for previous algorithms. Our bounds improve over the
existing ones, and simulations demonstrate the usefulness of these algorithms
compared with other state-of-the-art approaches.

15
The categories of this paper are: nucl-ex
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an