Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Dynamic Coded Caching in Wireless Networks Using Multi-Agent
  Reinforcement Learning   We consider distributed caching of content across several small base stations
(SBSs) in a wireless network, where the content is encoded using a maximum
distance separable code. Specifically, we apply soft time-to-live (STTL) cache
management policies, where coded packets may be evicted from the caches at
periodic times. We propose a reinforcement learning (RL) approach to find coded
STTL policies minimizing the overall network load. We demonstrate that such
caching policies achieve almost the same network load as policies obtained
through optimization, where the latter assumes perfect knowledge of the
distribution of times between file requests as well the distribution of the
number of SBSs within communication range of a user placing a request. We also
suggest a multi-agent RL (MARL) framework for the scenario of non-uniformly
distributed requests in space. For such a scenario, we show that MARL caching
policies achieve lower network load as compared to optimized caching policies
assuming a uniform request placement. We also provide convincing evidence that
synchronous updates offer a lower network load than asynchronous updates for
spatially homogeneous renewal request processes due to the memory of the
renewal processes.

23
The categories of this paper are: solv-int
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat