Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Novel Family of Boosted Online Regression Algorithms with Strong
  Theoretical Bounds   We investigate boosted online regression and propose a novel family of
regression algorithms with strong theoretical bounds. In addition, we implement
several variants of the proposed generic algorithm. We specifically provide
theoretical bounds for the performance of our proposed algorithms that hold in
a strong mathematical sense. We achieve guaranteed performance improvement over
the conventional online regression methods without any statistical assumptions
on the desired data or feature vectors. We demonstrate an intrinsic
relationship, in terms of boosting, between the adaptive mixture-of-experts and
data reuse algorithms. Furthermore, we introduce a boosting algorithm based on
random updates that is significantly faster than the conventional boosting
methods and other variants of our proposed algorithms while achieving an
enhanced performance gain. Hence, the random updates method is specifically
applicable to the fast and high dimensional streaming data. Specifically, we
investigate Newton Method-based and Stochastic Gradient Descent-based linear
regression algorithms in a mixture-of-experts setting and provide several
variants of these well-known adaptation methods. However, the proposed
algorithms can be extended to other base learners, e.g., nonlinear, tree-based
piecewise linear. Furthermore, we provide theoretical bounds for the
computational complexity of our proposed algorithms. We demonstrate substantial
performance gains in terms of mean square error over the base learners through
an extensive set of benchmark real data sets and simulated examples.

15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
33
The categories of this paper are: plasm-ph