Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Data-efficient Hindsight Off-policy Option Learning   We introduce Hindsight Off-policy Options (HO2), a data-efficient option
learning algorithm. Given any trajectory, HO2 infers likely option choices and
backpropagates through the dynamic programming inference procedure to robustly
train all policy components off-policy and end-to-end. The approach outperforms
existing option learning methods on common benchmarks. To better understand the
option framework and disentangle benefits from both temporal and action
abstraction, we evaluate ablations with flat policies and mixture policies with
comparable optimization. The results highlight the importance of both types of
abstraction as well as off-policy training and trust-region constraints,
particularly in challenging, simulated 3D robot manipulation tasks from raw
pixel inputs. Finally, we intuitively adapt the inference step to investigate
the effect of increased temporal abstraction on training with pre-trained
options and from scratch.

30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con