Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ENCONTER: Entity Constrained Progressive Sequence Generation via
  Insertion-based Transformer   Pretrained using large amount of data, autoregressive language models are
able to generate high quality sequences. However, these models do not perform
well under hard lexical constraints as they lack fine control of content
generation process. Progressive insertion-based transformers can overcome the
above limitation and efficiently generate a sequence in parallel given some
input tokens as constraint. These transformers however may fail to support hard
lexical constraints as their generation process is more likely to terminate
prematurely. The paper analyses such early termination problems and proposes
the Entity-constrained insertion transformer (ENCONTER), a new insertion
transformer that addresses the above pitfall without compromising much
generation efficiency. We introduce a new training strategy that considers
predefined hard lexical constraints (e.g., entities to be included in the
generated sequence). Our experiments show that ENCONTER outperforms other
baseline models in several performance metrics rendering it more suitable in
practical applications. Our code is available at
https://github.com/LARC-CMU-SMU/Enconter

25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg