Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: GraphNorm: A Principled Approach to Accelerating Graph Neural Network
  Training   Normalization is known to help the optimization of deep neural networks.
Curiously, different architectures require specialized normalization methods.
In this paper, we study what normalization is effective for Graph Neural
Networks (GNNs). First, we adapt and evaluate the existing methods from other
domains to GNNs. Faster convergence is achieved with InstanceNorm compared to
BatchNorm and LayerNorm. We provide an explanation by showing that InstanceNorm
serves as a preconditioner for GNNs, but such preconditioning effect is weaker
with BatchNorm due to the heavy batch noise in graph datasets. Second, we show
that the shift operation in InstanceNorm results in an expressiveness
degradation of GNNs for highly regular graphs. We address this issue by
proposing GraphNorm with a learnable shift. Empirically, GNNs with GraphNorm
converge faster compared to GNNs using other normalization. GraphNorm also
improves the generalization of GNNs, achieving better performance on graph
classification benchmarks.

15
The categories of this paper are: nucl-ex
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
29
The categories of this paper are: funct-an