Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MLQA: Evaluating Cross-lingual Extractive Question Answering   Question answering (QA) models have shown rapid progress enabled by the
availability of large, high-quality benchmark datasets. Such annotated datasets
are difficult and costly to collect, and rarely exist in languages other than
English, making training QA systems in other languages challenging. An
alternative to building large monolingual training datasets is to develop
cross-lingual systems which can transfer to a target language without requiring
training data in that language. In order to develop such systems, it is crucial
to invest in high quality multilingual evaluation benchmarks to measure
progress. We present MLQA, a multi-way aligned extractive QA evaluation
benchmark intended to spur research in this area. MLQA contains QA instances in
7 languages, namely English, Arabic, German, Spanish, Hindi, Vietnamese and
Simplified Chinese. It consists of over 12K QA instances in English and 5K in
each other language, with each QA instance being parallel between 4 languages
on average. MLQA is built using a novel alignment context strategy on Wikipedia
articles, and serves as a cross-lingual extension to existing extractive QA
datasets. We evaluate current state-of-the-art cross-lingual representations on
MLQA, and also provide machine-translation-based baselines. In all cases,
transfer results are shown to be significantly behind training-language
performance.

8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
33
The categories of this paper are: plasm-ph