Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Self-Consistent Trajectory Autoencoder: Hierarchical Reinforcement
  Learning with Trajectory Embeddings   In this work, we take a representation learning perspective on hierarchical
reinforcement learning, where the problem of learning lower layers in a
hierarchy is transformed into the problem of learning trajectory-level
generative models. We show that we can learn continuous latent representations
of trajectories, which are effective in solving temporally extended and
multi-stage problems. Our proposed model, SeCTAR, draws inspiration from
variational autoencoders, and learns latent representations of trajectories. A
key component of this method is to learn both a latent-conditioned policy and a
latent-conditioned model which are consistent with each other. Given the same
latent, the policy generates a trajectory which should match the trajectory
predicted by the model. This model provides a built-in prediction mechanism, by
predicting the outcome of closed loop policy behavior. We propose a novel
algorithm for performing hierarchical RL with this model, combining model-based
planning in the learned latent space with an unsupervised exploration
objective. We show that our model is effective at reasoning over long horizons
with sparse rewards for several simulated tasks, outperforming standard
reinforcement learning methods and prior methods for hierarchical reasoning,
model-based planning, and exploration.

26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg