Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Jointly Learnable Data Augmentations for Self-Supervised GNNs   Self-supervised Learning (SSL) aims at learning representations of objects
without relying on manual labeling. Recently, a number of SSL methods for graph
representation learning have achieved performance comparable to SOTA
semi-supervised GNNs. A Siamese network, which relies on data augmentation, is
the popular architecture used in these methods. However, these methods rely on
heuristically crafted data augmentation techniques. Furthermore, they use
either contrastive terms or other tricks (e.g., asymmetry) to avoid trivial
solutions that can occur in Siamese networks. In this study, we propose,
GraphSurgeon, a novel SSL method for GNNs with the following features. First,
instead of heuristics we propose a learnable data augmentation method that is
jointly learned with the embeddings by leveraging the inherent signal encoded
in the graph. In addition, we take advantage of the flexibility of the
learnable data augmentation and introduce a new strategy that augments in the
embedding space, called post augmentation. This strategy has a significantly
lower memory overhead and run-time cost. Second, as it is difficult to sample
truly contrastive terms, we avoid explicit negative sampling. Third, instead of
relying on engineering tricks, we use a scalable constrained optimization
objective motivated by Laplacian Eigenmaps to avoid trivial solutions. To
validate the practical use of GraphSurgeon, we perform empirical evaluation
using 14 public datasets across a number of domains and ranging from small to
large scale graphs with hundreds of millions of edges. Our finding shows that
GraphSurgeon is comparable to six SOTA semi-supervised and on par with five
SOTA self-supervised baselines in node classification tasks. The source code is
available at https://github.com/zekarias-tilahun/graph-surgeon.

18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
2
The categories of this paper are: math
16
The categories of this paper are: stat
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
7
The categories of this paper are: hep-th