Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multi-Stage Episodic Control for Strategic Exploration in Text Games   Text adventure games present unique challenges to reinforcement learning
methods due to their combinatorially large action spaces and sparse rewards.
The interplay of these two factors is particularly demanding because large
action spaces require extensive exploration, while sparse rewards provide
limited feedback. This work proposes to tackle the explore-vs-exploit dilemma
using a multi-stage approach that explicitly disentangles these two strategies
within each episode. Our algorithm, called eXploit-Then-eXplore (XTX), begins
each episode using an exploitation policy that imitates a set of promising
trajectories from the past, and then switches over to an exploration policy
aimed at discovering novel actions that lead to unseen state spaces. This
policy decomposition allows us to combine global decisions about which parts of
the game space to return to with curiosity-based local exploration in that
space, motivated by how a human may approach these games. Our method
significantly outperforms prior approaches by 27% and 11% average normalized
score over 12 games from the Jericho benchmark (Hausknecht et al., 2020) in
both deterministic and stochastic settings, respectively. On the game of Zork1,
in particular, XTX obtains a score of 103, more than a 2x improvement over
prior methods, and pushes past several known bottlenecks in the game that have
plagued previous state-of-the-art methods.

10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
26
The categories of this paper are: bayes-an
4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ