Training support for preemption. (#1419)
Training support for preemption. (#1419)

* Store extra training statistics in case of preemption.
* Fix bug found in review.

facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI