Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: The Choice Function Framework for Online Policy Improvement   There are notable examples of online search improving over hand-coded or
learned policies (e.g. AlphaZero) for sequential decision making. It is not
clear, however, whether or not policy improvement is guaranteed for many of
these approaches, even when given a perfect evaluation function and transition
model. Indeed, simple counter examples show that seemingly reasonable online
search procedures can hurt performance compared to the original policy. To
address this issue, we introduce the choice function framework for analyzing
online search procedures for policy improvement. A choice function specifies
the actions to be considered at every node of a search tree, with all other
actions being pruned. Our main contribution is to give sufficient conditions
for stationary and non-stationary choice functions to guarantee that the value
achieved by online search is no worse than the original policy. In addition, we
describe a general parametric class of choice functions that satisfy those
conditions and present an illustrative use case of the framework's empirical
utility.

33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
16
The categories of this paper are: stat
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat