Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Better Representation for Tables by Self-Supervised Tasks   Table-to-text generation aims at automatically generating natural text to
help people to conveniently obtain the important information in tables.
Although neural models for table-to-text have achieved remarkable progress,
some problems still overlooked. The first is that the values recorded in many
tables are mostly numbers in practice. The existing approaches do not do
special treatment for these, and still regard these as words in natural
language text. Secondly, the target texts in training dataset may contain
redundant information or facts do not exist in the input tables. These may give
wrong supervision signals to some methods based on content selection and
planning and auxiliary supervision. To solve these problems, we propose two
self-supervised tasks, Number Ordering and Significance Ordering, to help to
learn better table representation. The former works on the column dimension to
help to incorporate the size property of numbers into table representation. The
latter acts on row dimension and help to learn a significance-aware table
representation. We test our methods on the widely used dataset ROTOWIRE which
consists of NBA game statistic and related news. The experimental results
demonstrate that the model trained together with these two self-supervised
tasks can generate text that contains more salient and well-organized facts,
even without modeling context selection and planning. And we achieve the
state-of-the-art performance on automatic metrics.

27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph