Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Skill Transfer in Deep Reinforcement Learning under Morphological
  Heterogeneity   Transfer learning methods for reinforcement learning (RL) domains facilitate
the acquisition of new skills using previously acquired knowledge. The vast
majority of existing approaches assume that the agents have the same design,
e.g. same shape and action spaces. In this paper we address the problem of
transferring previously acquired skills amongst morphologically different
agents (MDAs). For instance, assuming that a bipedal agent has been trained to
move forward, could this skill be transferred on to a one-leg hopper so as to
make its training process for the same task more sample efficient? We frame
this problem as one of subspace learning whereby we aim to infer latent factors
representing the control mechanism that is common between MDAs. We propose a
novel paired variational encoder-decoder model, PVED, that disentangles the
control of MDAs into shared and agent-specific factors. The shared factors are
then leveraged for skill transfer using RL. Theoretically, we derive a theorem
indicating how the performance of PVED depends on the shared factors and agent
morphologies. Experimentally, PVED has been extensively validated on four
MuJoCo environments. We demonstrate its performance compared to a
state-of-the-art approach and several ablation cases, visualize and interpret
the hidden factors, and identify avenues for future improvements.

9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol