Quick fix for Structured Dropout checkpointing (#1406)
Quick fix for Structured Dropout checkpointing (#1406)

Summary:
Here's a quick fix for https://github.com/pytorch/fairseq/issues/1403.

To keep it short, this fix allows the user to checkpoint a translation model properly after applying layer pruning on a restored transformer file.
Pull Request resolved: https://github.com/pytorch/fairseq/pull/1406

Differential Revision: D18637540

Pulled By: myleott

fbshipit-source-id: 0f5e91e05e6579f0f459bc5293e9b14cb267322d

pytorch/fairseq,pytorch/fairseq,pytorch/fairseq