Quick solution to larger allreduce's: serial max-size allreduce calls.
Quick solution to larger allreduce's: serial max-size allreduce calls.

uwsampa/grappa,alexfrolov/grappa,alexfrolov/grappa,buaasun/grappa,alexfrolov/grappa,alexfrolov/grappa,buaasun/grappa,uwsampa/grappa,alexfrolov/grappa,buaasun/grappa,uwsampa/grappa,buaasun/grappa,uwsampa/grappa,uwsampa/grappa,alexfrolov/grappa,buaasun/grappa,uwsampa/grappa,buaasun/grappa,uwsampa/grappa,alexfrolov/grappa,buaasun/grappa