Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PsiPhi-Learning: Reinforcement Learning with Demonstrations using
  Successor Features and Inverse Temporal Difference Learning   We study reinforcement learning (RL) with no-reward demonstrations, a setting
in which an RL agent has access to additional data from the interaction of
other agents with the same environment. However, it has no access to the
rewards or goals of these agents, and their objectives and levels of expertise
may vary widely. These assumptions are common in multi-agent settings, such as
autonomous driving. To effectively use this data, we turn to the framework of
successor features. This allows us to disentangle shared features and dynamics
of the environment from agent-specific rewards and policies. We propose a
multi-task inverse reinforcement learning (IRL) algorithm, called \emph{inverse
temporal difference learning} (ITD), that learns shared state features,
alongside per-agent successor features and preference vectors, purely from
demonstrations without reward labels. We further show how to seamlessly
integrate ITD with learning from online environment interactions, arriving at a
novel algorithm for reinforcement learning with demonstrations, called $\Psi
\Phi$-learning (pronounced `Sci-Fi'). We provide empirical evidence for the
effectiveness of $\Psi \Phi$-learning as a method for improving RL, IRL,
imitation, and few-shot transfer, and derive worst-case bounds for its
performance in zero-shot transfer to new tasks.

14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph