Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: RocketQA: An Optimized Training Approach to Dense Passage Retrieval for
  Open-Domain Question Answering   In open-domain question answering, dense passage retrieval has become a new
paradigm to retrieve relevant passages for finding answers. Typically, the
dual-encoder architecture is adopted to learn dense representations of
questions and passages for semantic matching. However, it is difficult to
effectively train a dual-encoder due to the challenges including the
discrepancy between training and inference, the existence of unlabeled
positives and limited training data. To address these challenges, we propose an
optimized training approach, called RocketQA, to improving dense passage
retrieval. We make three major technical contributions in RocketQA, namely
cross-batch negatives, denoised hard negatives and data augmentation. The
experiment results show that RocketQA significantly outperforms previous
state-of-the-art models on both MSMARCO and Natural Questions. We also conduct
extensive experiments to examine the effectiveness of the three strategies in
RocketQA. Besides, we demonstrate that the performance of end-to-end QA can be
improved based on our RocketQA retriever.

31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
2
The categories of this paper are: math
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex