Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Joint AP Probing and Scheduling: A Contextual Bandit Approach   We consider a set of APs with unknown data rates that cooperatively serve a
mobile client. The data rate of each link is i.i.d. sampled from a distribution
that is unknown a priori. In contrast to traditional link scheduling problems
under uncertainty, we assume that in each time step, the device can probe a
subset of links before deciding which one to use. We model this problem as a
contextual bandit problem with probing (CBwP) and present an efficient
algorithm. We further establish the regret of our algorithm for links with
Bernoulli data rates. Our CBwP model is a novel extension of the classic
contextual bandit model and can potentially be applied to a large class of
sequential decision-making problems that involve joint probing and play under
uncertainty.

9
The categories of this paper are: nlin
19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom