Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reinforcement Ranking   We introduce a new framework for web page ranking -- reinforcement ranking --
that improves the stability and accuracy of Page Rank while eliminating the
need for computing the stationary distribution of random walks. Instead of
relying on teleportation to ensure a well defined Markov chain, we develop a
reverse-time reinforcement learning framework that determines web page
authority based on the solution of a reverse Bellman equation. In particular,
for a given reward function and surfing policy we recover a well defined
authority score from a reverse-time perspective: looking back from a web page,
what is the total incoming discounted reward brought by the surfer from the
page's predecessors? This results in a novel form of reverse-time
dynamic-programming/reinforcement-learning problem that achieves several
advantages over Page Rank based methods: First, stochasticity, ergodicity, and
irreducibility of the underlying Markov chain is no longer required for
well-posedness. Second, the method is less sensitive to graph topology and more
stable in the presence of dangling pages. Third, not only does the reverse
Bellman iteration yield a more efficient power iteration, it allows for faster
updating in the presence of graph changes. Finally, our experiments demonstrate
improvements in ranking quality.

33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess