Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AMBER: Adaptive Multi-Batch Experience Replay for Continuous Action
  Control   In this paper, a new adaptive multi-batch experience replay scheme is
proposed for proximal policy optimization (PPO) for continuous action control.
On the contrary to original PPO, the proposed scheme uses the batch samples of
past policies as well as the current policy for the update for the next policy,
where the number of the used past batches is adaptively determined based on the
oldness of the past batches measured by the average importance sampling (IS)
weight. The new algorithm constructed by combining PPO with the proposed
multi-batch experience replay scheme maintains the advantages of original PPO
such as random mini-batch sampling and small bias due to low IS weights by
storing the pre-computed advantages and values and adaptively determining the
mini-batch size. Numerical results show that the proposed method significantly
increases the speed and stability of convergence on various continuous control
tasks compared to original PPO.

15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org