Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Sequence-to-Sequence Knowledge Graph Completion and Question Answering   Knowledge graph embedding (KGE) models represent each entity and relation of
a knowledge graph (KG) with low-dimensional embedding vectors. These methods
have recently been applied to KG link prediction and question answering over
incomplete KGs (KGQA). KGEs typically create an embedding for each entity in
the graph, which results in large model sizes on real-world graphs with
millions of entities. For downstream tasks these atomic entity representations
often need to be integrated into a multi stage pipeline, limiting their
utility. We show that an off-the-shelf encoder-decoder Transformer model can
serve as a scalable and versatile KGE model obtaining state-of-the-art results
for KG link prediction and incomplete KG question answering. We achieve this by
posing KG link prediction as a sequence-to-sequence task and exchange the
triple scoring approach taken by prior KGE methods with autoregressive
decoding. Such a simple but powerful method reduces the model size up to 98%
compared to conventional KGE models while keeping inference time tractable.
After finetuning this model on the task of KGQA over incomplete KGs, our
approach outperforms baselines on multiple large-scale datasets without
extensive hyperparameter tuning.

20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
35
The categories of this paper are: mtrl-th
24
The categories of this paper are: dg-ga
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
8
The categories of this paper are: hep-ex