Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Unsupervised Document Embedding via Contrastive Augmentation   We present a contrasting learning approach with data augmentation techniques
to learn document representations in an unsupervised manner. Inspired by recent
contrastive self-supervised learning algorithms used for image and NLP
pretraining, we hypothesize that high-quality document embedding should be
invariant to diverse paraphrases that preserve the semantics of the original
document. With different backbones and contrastive learning frameworks, our
study reveals the enormous benefits of contrastive augmentation for document
representation learning with two additional insights: 1) including data
augmentation in a contrastive way can substantially improve the embedding
quality in unsupervised document representation learning, and 2) in general,
stochastic augmentations generated by simple word-level manipulation work much
better than sentence-level and document-level ones. We plug our method into a
classifier and compare it with a broad range of baseline methods on six
benchmark datasets. Our method can decrease the classification error rate by up
to 6.4% over the SOTA approaches on the document classification task, matching
or even surpassing fully-supervised methods.

9
The categories of this paper are: nlin
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ