Fix RNG saves in distributed mode. (#11620)
Fix RNG saves in distributed mode. (#11620)

* Fix RNG saves in distributed mode.

* Update src/transformers/trainer.py

Co-authored-by: Stas Bekman <7755b8071ff7368c870e3a79649c5b25a8766143@users.noreply.github.com>

Co-authored-by: Stas Bekman <7755b8071ff7368c870e3a79649c5b25a8766143@users.noreply.github.com>
huggingface/transformers,huggingface/transformers,huggingface/pytorch-transformers,huggingface/transformers,huggingface/transformers