Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Predictive Bandits   We introduce and study a new class of stochastic bandit problems, referred to
as predictive bandits. In each round, the decision maker first decides whether
to gather information about the rewards of particular arms (so that their
rewards in this round can be predicted). These measurements are costly, and may
be corrupted by noise. The decision maker then selects an arm to be actually
played in the round. Predictive bandits find applications in many areas; e.g.
they can be applied to channel selection problems in radio communication
systems. In this paper, we provide the first theoretical results about
predictive bandits, and focus on scenarios where the decision maker is allowed
to measure at most one arm per round. We derive asymptotic instance-specific
regret lower bounds for these problems, and develop algorithms whose regret
match these fundamental limits. We illustrate the performance of our algorithms
through numerical experiments. In particular, we highlight the gains that can
be achieved by using reward predictions, and investigate the impact of the
noise in the corresponding measurements.

33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat