Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning a Skill-sequence-dependent Policy for Long-horizon Manipulation
  Tasks   In recent years, the robotics community has made substantial progress in
robotic manipulation using deep reinforcement learning (RL). Effectively
learning of long-horizon tasks remains a challenging topic. Typical RL-based
methods approximate long-horizon tasks as Markov decision processes and only
consider current observation (images or other sensor information) as input
state. However, such approximation ignores the fact that skill-sequence also
plays a crucial role in long-horizon tasks. In this paper, we take both the
observation and skill sequences into account and propose a
skill-sequence-dependent hierarchical policy for solving a typical long-horizon
task. The proposed policy consists of a high-level skill policy (utilizing
skill sequences) and a low-level parameter policy (responding to observation)
with corresponding training methods, which makes the learning much more
sample-efficient. Experiments in simulation demonstrate that our approach
successfully solves a long-horizon task and is significantly faster than
Proximal Policy Optimization (PPO) and the task schema methods.

8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat