Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modulated Policy Hierarchies   Solving tasks with sparse rewards is a main challenge in reinforcement
learning. While hierarchical controllers are an intuitive approach to this
problem, current methods often require manual reward shaping, alternating
training phases, or manually defined sub tasks. We introduce modulated policy
hierarchies (MPH), that can learn end-to-end to solve tasks from sparse
rewards. To achieve this, we study different modulation signals and exploration
for hierarchical controllers. Specifically, we find that communicating via
bit-vectors is more efficient than selecting one out of multiple skills, as it
enables mixing between them. To facilitate exploration, MPH uses its different
time scales for temporally extended intrinsic motivation at each level of the
hierarchy. We evaluate MPH on the robotics tasks of pushing and sparse block
stacking, where it outperforms recent baselines.

12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
2
The categories of this paper are: math