Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: JointGT: Graph-Text Joint Representation Learning for Text Generation
  from Knowledge Graphs   Existing pre-trained models for knowledge-graph-to-text (KG-to-text)
generation simply fine-tune text-to-text pre-trained models such as BART or T5
on KG-to-text datasets, which largely ignore the graph structure during
encoding and lack elaborate pre-training tasks to explicitly model graph-text
alignments. To tackle these problems, we propose a graph-text joint
representation learning model called JointGT. During encoding, we devise a
structure-aware semantic aggregation module which is plugged into each
Transformer layer to preserve the graph structure. Furthermore, we propose
three new pre-training tasks to explicitly enhance the graph-text alignment
including respective text / graph reconstruction, and graph-text alignment in
the embedding space via Optimal Transport. Experiments show that JointGT
obtains new state-of-the-art performance on various KG-to-text datasets.

30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
27
The categories of this paper are: comp-gas
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
12
The categories of this paper are: nucl-th