Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Graph-adaptive Rectified Linear Unit for Graph Neural Networks   Graph Neural Networks (GNNs) have achieved remarkable success by extending
traditional convolution to learning on non-Euclidean data. The key to the GNNs
is adopting the neural message-passing paradigm with two stages: aggregation
and update. The current design of GNNs considers the topology information in
the aggregation stage. However, in the updating stage, all nodes share the same
updating function. The identical updating function treats each node embedding
as i.i.d. random variables and thus ignores the implicit relationships between
neighborhoods, which limits the capacity of the GNNs. The updating function is
usually implemented with a linear transformation followed by a non-linear
activation function. To make the updating function topology-aware, we inject
the topological information into the non-linear activation function and propose
Graph-adaptive Rectified Linear Unit (GReLU), which is a new parametric
activation function incorporating the neighborhood information in a novel and
efficient way. The parameters of GReLU are obtained from a hyperfunction based
on both node features and the corresponding adjacent matrix. To reduce the risk
of overfitting and the computational cost, we decompose the hyperfunction as
two independent components for nodes and features respectively. We conduct
comprehensive experiments to show that our plug-and-play GReLU method is
efficient and effective given different GNN backbones and various downstream
tasks.

27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom