Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Layer-Wise Multi-View Learning for Neural Machine Translation   Traditional neural machine translation is limited to the topmost encoder
layer's context representation and cannot directly perceive the lower encoder
layers. Existing solutions usually rely on the adjustment of network
architecture, making the calculation more complicated or introducing additional
structural restrictions. In this work, we propose layer-wise multi-view
learning to solve this problem, circumventing the necessity to change the model
structure. We regard each encoder layer's off-the-shelf output, a by-product in
layer-by-layer encoding, as the redundant view for the input sentence. In this
way, in addition to the topmost encoder layer (referred to as the primary
view), we also incorporate an intermediate encoder layer as the auxiliary view.
We feed the two views to a partially shared decoder to maintain independent
prediction. Consistency regularization based on KL divergence is used to
encourage the two views to learn from each other. Extensive experimental
results on five translation tasks show that our approach yields stable
improvements over multiple strong baselines. As another bonus, our method is
agnostic to network architectures and can maintain the same inference speed as
the original model.

27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
16
The categories of this paper are: stat
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat