Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Q-Learning: Theoretical Insights from an Asymptotic Analysis   Deep Q-Learning is an important reinforcement learning algorithm, which
involves training a deep neural network, called Deep Q-Network (DQN), to
approximate the well-known Q-function. Although wildly successful under
laboratory conditions, serious gaps between theory and practice as well as a
lack of formal guarantees prevent its use in the real world. Adopting a
dynamical systems perspective, we provide a theoretical analysis of a popular
version of Deep Q-Learning under realistic and verifiable assumptions. More
specifically, we prove an important result on the convergence of the algorithm,
characterizing the asymptotic behavior of the learning process. Our result
sheds light on hitherto unexplained properties of the algorithm and helps
understand empirical observations, such as performance inconsistencies even
after training. Unlike previous theories, our analysis accommodates state
Markov processes with multiple stationary distributions. In spite of the focus
on Deep Q-Learning, we believe that our theory may be applied to understand
other deep learning algorithms

11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
36
The categories of this paper are: cmp-lg
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga