Always use SequentialSampler during evaluation
Always use SequentialSampler during evaluation

When evaluating, shouldn't we always use the SequentialSampler instead of DistributedSampler? Evaluation only runs on 1 GPU no matter what, so if you use the DistributedSampler with N GPUs, I think you'll only evaluate on 1/N of the evaluation set. That's at least what I'm finding when I run an older/modified version of this repo.
huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/pytorch-transformers