Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Direct then Diffuse: Incremental Unsupervised Skill Discovery for State
  Covering and Goal Reaching   Learning meaningful behaviors in the absence of reward is a difficult problem
in reinforcement learning. A desirable and challenging unsupervised objective
is to learn a set of diverse skills that provide a thorough coverage of the
state space while being directed, i.e., reliably reaching distinct regions of
the environment. In this paper, we build on the mutual information framework
for skill discovery and introduce UPSIDE, which addresses the
coverage-directedness trade-off in the following ways: 1) We design policies
with a decoupled structure of a directed skill, trained to reach a specific
region, followed by a diffusing part that induces a local coverage. 2) We
optimize policies by maximizing their number under the constraint that each of
them reaches distinct regions of the environment (i.e., they are sufficiently
discriminable) and prove that this serves as a lower bound to the original
mutual information objective. 3) Finally, we compose the learned directed
skills into a growing tree that adaptively covers the environment. We
illustrate in several navigation and control environments how the skills
learned by UPSIDE solve sparse-reward downstream tasks better than existing
baselines.

12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
7
The categories of this paper are: hep-th