Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unsupervised Representation Learning by InvariancePropagation   Unsupervised learning methods based on contrastive learning have drawn
increasing attention and achieved promising results. Most of them aim to learn
representations invariant to instance-level variations, which are provided by
different views of the same instance. In this paper, we propose Invariance
Propagation to focus on learning representations invariant to category-level
variations, which are provided by different instances from the same category.
Our method recursively discovers semantically consistent samples residing in
the same high-density regions in representation space. We demonstrate a hard
sampling strategy to concentrate on maximizing the agreement between the anchor
sample and its hard positive samples, which provide more intra-class variations
to help capture more abstract invariance. As a result, with a ResNet-50 as the
backbone, our method achieves 71.3% top-1 accuracy on ImageNet linear
classification and 78.2% top-5 accuracy fine-tuning on only 1% labels,
surpassing previous results. We also achieve state-of-the-art performance on
other downstream tasks, including linear classification on Places205 and Pascal
VOC, and transfer learning on small scale datasets.

25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
16
The categories of this paper are: stat
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin