Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Power Allocation for Cognitive Wireless Mesh Networks by Applying
  Multi-agent Q-learning Approach   As the scarce spectrum resource is becoming over-crowded, cognitive radios
(CRs) indicate great flexibility to improve the spectrum efficiency by
opportunistically accessing the authorized frequency bands. One of the critical
challenges for operating such radios in a network is how to efficiently
allocate transmission powers and frequency resource among the secondary users
(SUs) while satisfying the quality-of-service (QoS) constraints of the primary
users (PUs). In this paper, we focus on the non-cooperative power allocation
problem in cognitive wireless mesh networks (CogMesh) formed by a number of
clusters with the consideration of energy efficiency. Due to the SUs' selfish
and spontaneous properties, the problem is modeled as a stochastic learning
process. We first extend the single-agent Q-learning to a multi-user context,
and then propose a conjecture based multi-agent Qlearning algorithm to achieve
the optimal transmission strategies with only private and incomplete
information. An intelligent SU performs Q-function updates based on the
conjecture over the other SUs' stochastic behaviors. This learning algorithm
provably converges given certain restrictions that arise during learning
procedure. Simulation experiments are used to verify the performance of our
algorithm and demonstrate its effectiveness of improving the energy efficiency.

8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph