Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Augmentations in Graph Contrastive Learning: Current Methodological
  Flaws & Towards Better Practices   Unsupervised graph representation learning is critical to a wide range of
applications where labels may be scarce or expensive to procure. Contrastive
learning (CL) is an increasingly popular paradigm for such settings and the
state-of-the-art in unsupervised visual representation learning. Recent work
attributes the success of visual CL to use of task-relevant augmentations and
large, diverse datasets. Interestingly, graph CL frameworks report strong
performance despite using orders of magnitude smaller datasets and employing
domain-agnostic graph augmentations (DAGAs). Motivated by this discrepancy, we
probe the quality of representations learnt by popular graph CL frameworks
using DAGAs. We find that DAGAs can destroy task-relevant information and harm
the model's ability to learn discriminative representations. On small benchmark
datasets, we show the inductive bias of graph neural networks can significantly
compensate for this weak discriminability. Based on our findings, we propose
several sanity checks that enable practitioners to quickly assess the quality
of their model's learned representations. We further propose a broad strategy
for designing task-aware augmentations that are amenable to graph CL and
demonstrate its efficacy on two large-scale, complex graph applications. For
example, in graph-based document classification, we show task-aware
augmentations improve accuracy up to 20%.

2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph