Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Mining Knowledge for Natural Language Inference from Wikipedia
  Categories   Accurate lexical entailment (LE) and natural language inference (NLI) often
require large quantities of costly annotations. To alleviate the need for
labeled data, we introduce WikiNLI: a resource for improving model performance
on NLI and LE tasks. It contains 428,899 pairs of phrases constructed from
naturally annotated category hierarchies in Wikipedia. We show that we can
improve strong baselines such as BERT and RoBERTa by pretraining them on
WikiNLI and transferring the models on downstream tasks. We conduct systematic
comparisons with phrases extracted from other knowledge bases such as WordNet
and Wikidata to find that pretraining on WikiNLI gives the best performance. In
addition, we construct WikiNLI in other languages, and show that pretraining on
them improves performance on NLI tasks of corresponding languages.

3
The categories of this paper are: physics
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
2
The categories of this paper are: math