Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Interpreting Graph Neural Networks for NLP With Differentiable Edge
  Masking   Graph neural networks (GNNs) have become a popular approach to integrating
structural inductive biases into NLP models. However, there has been little
work on interpreting them, and specifically on understanding which parts of the
graphs (e.g. syntactic trees or co-reference structures) contribute to a
prediction. In this work, we introduce a post-hoc method for interpreting the
predictions of GNNs which identifies unnecessary edges. Given a trained GNN
model, we learn a simple classifier that, for every edge in every layer,
predicts if that edge can be dropped. We demonstrate that such a classifier can
be trained in a fully differentiable fashion, employing stochastic gates and
encouraging sparsity through the expected $L_0$ norm. We use our technique as
an attribution method to analyze GNN models for two tasks -- question answering
and semantic role labeling -- providing insights into the information flow in
these models. We show that we can drop a large proportion of edges without
deteriorating the performance of the model, while we can analyse the remaining
edges for interpreting model predictions.

27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph