Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Large-Scale Study of Curiosity-Driven Learning   Reinforcement learning algorithms rely on carefully engineering environment
rewards that are extrinsic to the agent. However, annotating each environment
with hand-designed, dense rewards is not scalable, motivating the need for
developing reward functions that are intrinsic to the agent. Curiosity is a
type of intrinsic reward function which uses prediction error as reward signal.
In this paper: (a) We perform the first large-scale study of purely
curiosity-driven learning, i.e. without any extrinsic rewards, across 54
standard benchmark environments, including the Atari game suite. Our results
show surprisingly good performance, and a high degree of alignment between the
intrinsic curiosity objective and the hand-designed extrinsic rewards of many
game environments. (b) We investigate the effect of using different feature
spaces for computing prediction error and show that random features are
sufficient for many popular RL game benchmarks, but learned features appear to
generalize better (e.g. to novel game levels in Super Mario Bros.). (c) We
demonstrate limitations of the prediction-based rewards in stochastic setups.
Game-play videos and code are at
https://pathak22.github.io/large-scale-curiosity/

22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
14
The categories of this paper are: math-ph
19
The categories of this paper are: eess
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex