[Trainer] Fix _rotate_checkpoints
[Trainer] Fix _rotate_checkpoints

Close #3920

huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/pytorch-transformers,huggingface/transformers