Allow to restart with optimizers on CUDA (#1144)
Allow to restart with optimizers on CUDA (#1144)

* Allow to restart with optimizers on CUDA

* pylint

allenai/allennlp,allenai/allennlp,allenai/allennlp,allenai/allennlp