Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Online Learning and Optimization of Markov Jump Affine Models   The problem of online learning and optimization of unknown Markov jump affine
models is considered. An online learning policy, referred to as Markovian
simultaneous perturbations stochastic approximation (MSPSA), is proposed for
two different optimization objectives: (i) the quadratic cost minimization of
the regulation problem and (ii) the revenue (profit) maximization problem. It
is shown that the regret of MSPSA grows at the order of the square root of the
learning horizon. Furthermore, by the use of van Trees inequality, it is shown
that the regret of any policy grows no slower than that of MSPSA, making MSPSA
an order optimal learning policy. In addition, it is also shown that the MSPSA
policy converges to the optimal control input almost surely as well as in the
mean square sense. Simulation results are presented to illustrate the regret
growth rate of MSPSA and to show that MSPSA can offer significant gain over the
greedy certainty equivalent approach.

19
The categories of this paper are: eess
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc