Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reinforcement Learning in POMDPs with Memoryless Options and
  Option-Observation Initiation Sets   Many real-world reinforcement learning problems have a hierarchical nature,
and often exhibit some degree of partial observability. While hierarchy and
partial observability are usually tackled separately (for instance by combining
recurrent neural networks and options), we show that addressing both problems
simultaneously is simpler and more efficient in many cases. More specifically,
we make the initiation set of options conditional on the previously-executed
option, and show that options with such Option-Observation Initiation Sets
(OOIs) are at least as expressive as Finite State Controllers (FSCs), a
state-of-the-art approach for learning in POMDPs. OOIs are easy to design based
on an intuitive description of the task, lead to explainable policies and keep
the top-level and option policies memoryless. Our experiments show that OOIs
allow agents to learn optimal policies in challenging POMDPs, while being much
more sample-efficient than a recurrent neural network over options.

11
The categories of this paper are: hep-lat
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
2
The categories of this paper are: math
19
The categories of this paper are: eess