Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MDPs with Unawareness   Markov decision processes (MDPs) are widely used for modeling decision-making
problems in robotics, automated control, and economics. Traditional MDPs assume
that the decision maker (DM) knows all states and actions. However, this may
not be true in many situations of interest. We define a new framework, MDPs
with unawareness (MDPUs) to deal with the possibilities that a DM may not be
aware of all possible actions. We provide a complete characterization of when a
DM can learn to play near-optimally in an MDPU, and give an algorithm that
learns to play near-optimally when it is possible to do so, as efficiently as
possible. In particular, we characterize when a near-optimal solution can be
found in polynomial time.

32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con