Add fairscale and deepspeed back to the CI (#11147)
Add fairscale and deepspeed back to the CI (#11147)

* Add fairscale and deepspeed back to the CI

* Add deepspeed to single GPU tests
huggingface/pytorch-transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers