Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Is Deep Reinforcement Learning Really Superhuman on Atari? Leveling the
  playing field   Consistent and reproducible evaluation of Deep Reinforcement Learning (DRL)
is not straightforward. In the Arcade Learning Environment (ALE), small changes
in environment parameters such as stochasticity or the maximum allowed play
time can lead to very different performance. In this work, we discuss the
difficulties of comparing different agents trained on ALE. In order to take a
step further towards reproducible and comparable DRL, we introduce SABER, a
Standardized Atari BEnchmark for general Reinforcement learning algorithms. Our
methodology extends previous recommendations and contains a complete set of
environment parameters as well as train and test procedures. We then use SABER
to evaluate the current state of the art, Rainbow. Furthermore, we introduce a
human world records baseline, and argue that previous claims of expert or
superhuman performance of DRL might not be accurate. Finally, we propose
Rainbow-IQN by extending Rainbow with Implicit Quantile Networks (IQN) leading
to new state-of-the-art performance. Source code is available for
reproducibility.

32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
36
The categories of this paper are: cmp-lg
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con