Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Decentralized Q-Learning for Stochastic Teams and Games   There are only a few learning algorithms applicable to stochastic dynamic
teams and games which generalize Markov decision processes to decentralized
stochastic control problems involving possibly self-interested decision makers.
Learning in games is generally difficult because of the non-stationary
environment in which each decision maker aims to learn its optimal decisions
with minimal information in the presence of the other decision makers who are
also learning. In stochastic dynamic games, learning is more challenging
because, while learning, the decision makers alter the state of the system and
hence the future cost. In this paper, we present decentralized Q-learning
algorithms for stochastic games, and study their convergence for the weakly
acyclic case which includes team problems as an important special case. The
algorithm is decentralized in that each decision maker has access to only its
local information, the state information, and the local cost realizations;
furthermore, it is completely oblivious to the presence of other decision
makers. We show that these algorithms converge to equilibrium policies almost
surely in large classes of stochastic games.

34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg