Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Convergence Theory of Debiased Model-Agnostic Meta-Reinforcement
  Learning   We consider Model-Agnostic Meta-Learning (MAML) methods for Reinforcement
Learning (RL) problems, where the goal is to find a policy using data from
several tasks represented by Markov Decision Processes (MDPs) that can be
updated by one step of stochastic policy gradient for the realized MDP. In
particular, using stochastic gradients in MAML update steps is crucial for RL
problems since computation of exact gradients requires access to a large number
of possible trajectories. For this formulation, we propose a variant of the
MAML method, named Stochastic Gradient Meta-Reinforcement Learning (SG-MRL),
and study its convergence properties. We derive the iteration and sample
complexity of SG-MRL to find an $\epsilon$-first-order stationary point, which,
to the best of our knowledge, provides the first convergence guarantee for
model-agnostic meta-reinforcement learning algorithms. We further show how our
results extend to the case where more than one step of stochastic policy
gradient method is used at test time. Finally, we empirically compare SG-MRL
and MAML in several deep RL environments.

20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph