Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Middle-Out Decoding   Despite being virtually ubiquitous, sequence-to-sequence models are
challenged by their lack of diversity and inability to be externally
controlled. In this paper, we speculate that a fundamental shortcoming of
sequence generation models is that the decoding is done strictly from
left-to-right, meaning that outputs values generated earlier have a profound
effect on those generated later. To address this issue, we propose a novel
middle-out decoder architecture that begins from an initial middle-word and
simultaneously expands the sequence in both directions. To facilitate
information flow and maintain consistent decoding, we introduce a dual
self-attention mechanism that allows us to model complex dependencies between
the outputs. We illustrate the performance of our model on the task of video
captioning, as well as a synthetic sequence de-noising task. Our middle-out
decoder achieves significant improvements on de-noising and competitive
performance in the task of video captioning, while quantifiably improving the
caption diversity. Furthermore, we perform a qualitative analysis that
demonstrates our ability to effectively control the generation process of our
decoder.

31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc