Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Non-Clicks Mean Irrelevant? Propensity Ratio Scoring As a Correction   Recent advances in unbiased learning to rank (LTR) count on Inverse
Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though
theoretically sound in correcting the bias introduced by treating clicked
documents as relevant, IPS ignores the bias caused by (implicitly) treating
non-clicked ones as irrelevant. In this work, we first rigorously prove that
such use of click data leads to unnecessary pairwise comparisons between
relevant documents, which prevent unbiased ranker optimization. Based on the
proof, we derive a simple yet well justified new weighting scheme, called
Propensity Ratio Scoring (PRS), which provides treatments on both clicks and
non-clicks. Besides correcting the bias in clicks, PRS avoids relevant-relevant
document comparisons in LTR training and enjoys a lower variability. Our
extensive empirical evaluations confirm that PRS ensures a more effective use
of click data and improved performance in both synthetic data from a set of LTR
benchmarks, as well as in the real-world large-scale data from GMail search.

24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
9
The categories of this paper are: nlin
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas