Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: UniVIP: A Unified Framework for Self-Supervised Visual Pre-training   Self-supervised learning (SSL) holds promise in leveraging large amounts of
unlabeled data. However, the success of popular SSL methods has limited on
single-centric-object images like those in ImageNet and ignores the correlation
among the scene and instances, as well as the semantic difference of instances
in the scene. To address the above problems, we propose a Unified
Self-supervised Visual Pre-training (UniVIP), a novel self-supervised framework
to learn versatile visual representations on either single-centric-object or
non-iconic dataset. The framework takes into account the representation
learning at three levels: 1) the similarity of scene-scene, 2) the correlation
of scene-instance, 3) the discrimination of instance-instance. During the
learning, we adopt the optimal transport algorithm to automatically measure the
discrimination of instances. Massive experiments show that UniVIP pre-trained
on non-iconic COCO achieves state-of-the-art transfer performance on a variety
of downstream tasks, such as image classification, semi-supervised learning,
object detection and segmentation. Furthermore, our method can also exploit
single-centric-object dataset such as ImageNet and outperforms BYOL by 2.5%
with the same pre-training epochs in linear probing, and surpass current
self-supervised object detection methods on COCO dataset, demonstrating its
universality and potential.

35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
31
The categories of this paper are: ao-sci