Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Pruning-then-Expanding Model for Domain Adaptation of Neural Machine
  Translation   Domain Adaptation is widely used in practical applications of neural machine
translation, which aims to achieve good performance on both the general-domain
and in-domain. However, the existing methods for domain adaptation usually
suffer from catastrophic forgetting, domain divergence, and model explosion. To
address these three problems, we propose a method of "divide and conquer" which
is based on the importance of neurons or parameters in the translation model.
In our method, we first prune the model and only keep the important neurons or
parameters, making them responsible for both general-domain and in-domain
translation. Then we further train the pruned model supervised by the original
unpruned model with the knowledge distillation method. Last we expand the model
to the original size and fine-tune the added parameters for the in-domain
translation. We conduct experiments on different languages and domains and the
results show that our method can achieve significant improvements compared with
several strong baselines.

29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
16
The categories of this paper are: stat
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org