Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Accelerating Training in Pommerman with Imitation and Reinforcement
  Learning   The Pommerman simulation was recently developed to mimic the classic Japanese
game Bomberman, and focuses on competitive gameplay in a multi-agent setting.
We focus on the 2$\times$2 team version of Pommerman, developed for a
competition at NeurIPS 2018. Our methodology involves training an agent
initially through imitation learning on a noisy expert policy, followed by a
proximal-policy optimization (PPO) reinforcement learning algorithm. The basic
PPO approach is modified for stable transition from the imitation learning
phase through reward shaping, action filters based on heuristics, and
curriculum learning. The proposed methodology is able to beat heuristic and
pure reinforcement learning baselines with a combined 100,000 training games,
significantly faster than other non-tree-search methods in literature. We
present results against multiple agents provided by the developers of the
simulation, including some that we have enhanced. We include a sensitivity
analysis over different parameters, and highlight undesirable effects of some
strategies that initially appear promising. Since Pommerman is a complex
multi-agent competitive environment, the strategies developed here provide
insights into several real-world problems with characteristics such as partial
observability, decentralized execution (without communication), and very sparse
and delayed rewards.

31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
14
The categories of this paper are: math-ph
24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an