Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Neural Transducer   Sequence-to-sequence models have achieved impressive results on various
tasks. However, they are unsuitable for tasks that require incremental
predictions to be made as more data arrives or tasks that have long input
sequences and output sequences. This is because they generate an output
sequence conditioned on an entire input sequence. In this paper, we present a
Neural Transducer that can make incremental predictions as more input arrives,
without redoing the entire computation. Unlike sequence-to-sequence models, the
Neural Transducer computes the next-step distribution conditioned on the
partially observed input sequence and the partially generated sequence. At each
time step, the transducer can decide to emit zero to many output symbols. The
data can be processed using an encoder and presented as input to the
transducer. The discrete decision to emit a symbol at every time step makes it
difficult to learn with conventional backpropagation. It is however possible to
train the transducer by using a dynamic programming algorithm to generate
target discrete decisions. Our experiments show that the Neural Transducer
works well in settings where it is required to produce output predictions as
data come in. We also find that the Neural Transducer performs well for long
sequences even when attention mechanisms are not used.

16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess