Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Multiple Markov Chains via Adaptive Allocation   We study the problem of learning the transition matrices of a set of Markov
chains from a single stream of observations on each chain. We assume that the
Markov chains are ergodic but otherwise unknown. The learner can sample Markov
chains sequentially to observe their states. The goal of the learner is to
sequentially select various chains to learn transition matrices uniformly well
with respect to some loss function. We introduce a notion of loss that
naturally extends the squared loss for learning distributions to the case of
Markov chains, and further characterize the notion of being \emph{uniformly
good} in all problem instances. We present a novel learning algorithm that
efficiently balances \emph{exploration} and \emph{exploitation} intrinsic to
this problem, without any prior knowledge of the chains. We provide
finite-sample PAC-type guarantees on the performance of the algorithm. Further,
we show that our algorithm asymptotically attains an optimal loss.

24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics