Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exploring Offline Policy Evaluation for the Continuous-Armed Bandit
  Problem   The (contextual) multi-armed bandit problem (MAB) provides a formalization of
sequential decision-making which has many applications. However, validly
evaluating MAB policies is challenging; we either resort to simulations which
inherently include debatable assumptions, or we resort to expensive field
trials. Recently an offline evaluation method has been suggested that is based
on empirical data, thus relaxing the assumptions, and can be used to evaluate
multiple competing policies in parallel. This method is however not directly
suited for the continuous armed (CAB) problem; an often encountered version of
the MAB problem in which the action set is continuous instead of discrete. We
propose and evaluate an extension of the existing method such that it can be
used to evaluate CAB policies. We empirically demonstrate that our method
provides a relatively consistent ranking of policies. Furthermore, we detail
how our method can be used to select policies in a real-life CAB problem.

37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
0
The categories of this paper are: hep-ph
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ