Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modeling Document Interactions for Learning to Rank with Regularized
  Self-Attention   Learning to rank is an important task that has been successfully deployed in
many real-world information retrieval systems. Most existing methods compute
relevance judgments of documents independently, without holistically
considering the entire set of competing documents. In this paper, we explore
modeling documents interactions with self-attention based neural networks.
Although self-attention networks have achieved state-of-the-art results in many
NLP tasks, we find empirically that self-attention provides little benefit over
baseline neural learning to rank architecture. To improve the learning of
self-attention weights, We propose simple yet effective regularization terms
designed to model interactions between documents. Evaluations on publicly
available Learning to Rank (LETOR) datasets show that training self-attention
network with our proposed regularization terms can significantly outperform
existing learning to rank methods.

32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph