Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Understanding Back-Translation at Scale   An effective method to improve neural machine translation with monolingual
data is to augment the parallel training corpus with back-translations of
target language sentences. This work broadens the understanding of
back-translation and investigates a number of methods to generate synthetic
source sentences. We find that in all but resource poor settings
back-translations obtained via sampling or noised beam outputs are most
effective. Our analysis shows that sampling or noisy synthetic data gives a
much stronger training signal than data generated by beam or greedy search. We
also compare how synthetic data compares to genuine bitext and study various
domain effects. Finally, we scale to hundreds of millions of monolingual
sentences and achieve a new state of the art of 35 BLEU on the WMT'14
English-German test set.

31
The categories of this paper are: ao-sci
7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
23
The categories of this paper are: solv-int
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph