[deepspeed] fix resume from checkpoint (#11352)
[deepspeed] fix resume from checkpoint (#11352)

This PR fixes a bug that most likely somehow got exposed (not caused) by https://github.com/huggingface/transformers/pull/11318 - surprisingly the same test worked just fine before that other PR.

huggingface/transformers,huggingface/pytorch-transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers