Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Residual Tree Aggregation of Layers for Neural Machine Translation   Although attention-based Neural Machine Translation has achieved remarkable
progress in recent layers, it still suffers from issue of making insufficient
use of the output of each layer. In transformer, it only uses the top layer of
encoder and decoder in the subsequent process, which makes it impossible to
take advantage of the useful information in other layers. To address this
issue, we propose a residual tree aggregation of layers for Transformer(RTAL),
which helps to fuse information across layers. Specifically, we try to fuse the
information across layers by constructing a post-order binary tree. In
additional to the last node, we add the residual connection to the process of
generating child nodes. Our model is based on the Neural Machine Translation
model Transformer and we conduct our experiments on WMT14 English-to-German and
WMT17 English-to-France translation tasks. Experimental results across language
pairs show that the proposed approach outperforms the strong baseline model
significantly

35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
16
The categories of this paper are: stat
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin