Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multi-armed bandit problem with precedence relations   Consider a multi-phase project management problem where the decision maker
needs to deal with two issues: (a) how to allocate resources to projects within
each phase, and (b) when to enter the next phase, so that the total expected
reward is as large as possible. We formulate the problem as a multi-armed
bandit problem with precedence relations. In Chan, Fuh and Hu (2005), a class
of asymptotically optimal arm-pulling strategies is constructed to minimize the
shortfall from perfect information payoff. Here we further explore optimality
properties of the proposed strategies. First, we show that the efficiency
benchmark, which is given by the regret lower bound, reduces to those in Lai
and Robbins (1985), Hu and Wei (1989), and Fuh and Hu (2000). This implies that
the proposed strategy is also optimal under the settings of aforementioned
papers. Secondly, we establish the super-efficiency of proposed strategies when
the bad set is empty. Thirdly, we show that they are still optimal with
constant switching cost between arms. In addition, we prove that the Wald's
equation holds for Markov chains under Harris recurrent condition, which is an
important tool in studying the efficiency of the proposed strategies.

18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga