Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Comparing Fair Ranking Metrics   Ranked lists are frequently used by information retrieval (IR) systems to
present results believed to be relevant to the users information need. Fairness
is a relatively new but important aspect of these rankings to measure, joining
a rich set of metrics that go beyond traditional accuracy or utility constructs
to provide a more holistic understanding of IR system behavior. In the last few
years, several metrics have been proposed to quantify the (un)fairness of
rankings, particularly with respect to particular group(s) of content
providers, but comparative analyses of these metrics -- particularly for IR --
is lacking. There is limited guidance, therefore, to decide what fairness
metrics are applicable to a specific scenario, or assessment of the extent to
which metrics agree or disagree applied to real data. In this paper, we
describe several fair ranking metrics from existing literature in a common
notation, enabling direct comparison of their assumptions, goals, and design
choices; we then empirically compare them on multiple data sets covering both
search and recommendation tasks.

35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics