Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multi-Stream Transformers   Transformer-based encoder-decoder models produce a fused token-wise
representation after every encoder layer. We investigate the effects of
allowing the encoder to preserve and explore alternative hypotheses, combined
at the end of the encoding process. To that end, we design and examine a
$\textit{Multi-stream Transformer}$ architecture and find that splitting the
Transformer encoder into multiple encoder streams and allowing the model to
merge multiple representational hypotheses improves performance, with further
improvement obtained by adding a skip connection between the first and the
final encoder layer.

21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an