Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An Information-Theoretic Perspective on Credit Assignment in
  Reinforcement Learning   How do we formalize the challenge of credit assignment in reinforcement
learning? Common intuition would draw attention to reward sparsity as a key
contributor to difficult credit assignment and traditional heuristics would
look to temporal recency for the solution, calling upon the classic eligibility
trace. We posit that it is not the sparsity of the reward itself that causes
difficulty in credit assignment, but rather the \emph{information sparsity}. We
propose to use information theory to define this notion, which we then use to
characterize when credit assignment is an obstacle to efficient learning. With
this perspective, we outline several information-theoretic mechanisms for
measuring credit under a fixed behavior policy, highlighting the potential of
information theory as a key tool towards provably-efficient credit assignment.

13
The categories of this paper are: quant-ph
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas