Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning and Planning in Average-Reward Markov Decision Processes   We introduce learning and planning algorithms for average-reward MDPs,
including 1) the first general proven-convergent off-policy model-free control
algorithm without reference states, 2) the first proven-convergent off-policy
model-free prediction algorithm, and 3) the first off-policy learning algorithm
that converges to the actual value function rather than to the value function
plus an offset. All of our algorithms are based on using the
temporal-difference error rather than the conventional error when updating the
estimate of the average reward. Our proof techniques are a slight
generalization of those by Abounadi, Bertsekas, and Borkar (2001). In
experiments with an Access-Control Queuing Task, we show some of the
difficulties that can arise when using methods that rely on reference states
and argue that our new algorithms can be significantly easier to use.

33
The categories of this paper are: plasm-ph
23
The categories of this paper are: solv-int
16
The categories of this paper are: stat
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom