Isolated benchmarking support (#7662)
Isolated benchmarking support (#7662)

* Change namespace and make logging functionality changes

* Help comment changes

* Isolated benchmarking support for IO Compute and Communication

* Change logging statements and use asserts

* Change flag check

* Count number of cpu cores

* Logging only for cpu workers

* Add rank to final logging

* Use dummy iter when measuring comm only, use measure_only for all COMM, COMP and IO

* Change COMPUTE to COMP

* Change to .format

yajiedesign/mxnet,ForkedReposBak/mxnet,tlby/mxnet,jiajiechen/mxnet,ptrendx/mxnet,rahul003/mxnet,navrasio/mxnet,leezu/mxnet,dmlc/mxnet,dmlc/mxnet,vikingMei/mxnet,tornadomeet/mxnet,kkk669/mxnet,hpi-xnor/BMXNet,jamesliu/mxnet,Northrend/mxnet,rahul003/mxnet,ykim362/mxnet,piiswrong/mxnet,zhreshold/mxnet,fullfanta/mxnet,yajiedesign/mxnet,fullfanta/mxnet,leezu/mxnet,eric-haibin-lin/mxnet,jennyzhang0215/incubator-mxnet,sxjscience/mxnet,smolix/incubator-mxnet,precedenceguo/mxnet,wangyum/mxnet,navrasio/mxnet,tlby/mxnet,DickJC123/mxnet,formath/mxnet,rahul003/mxnet,larroy/mxnet,fullfanta/mxnet,Mega-DatA-Lab/mxnet,Mega-DatA-Lab/mxnet,navrasio/mxnet,jennyzhang0215/incubator-mxnet,antoan2/incubator-mxnet,leezu/mxnet,zhreshold/mxnet,LinkHS/incubator-mxnet,LinkHS/incubator-mxnet,Mega-DatA-Lab/mxnet,ykim362/mxnet,sxjscience/mxnet,ptrendx/mxnet,fullfanta/mxnet,hpi-xnor/BMXNet,Northrend/mxnet,ForkedReposBak/mxnet,mbaijal/incubator-mxnet,LinkHS/incubator-mxnet,indhub/mxnet,weleen/mxnet,larroy/mxnet,smolix/incubator-mxnet,formath/mxnet,eric-haibin-lin/mxnet,sxjscience/mxnet,DickJC123/mxnet,LinkHS/incubator-mxnet,TuSimple/mxnet,szha/mxnet,Mega-DatA-Lab/mxnet,ZihengJiang/mxnet,yuruofeifei/mxnet,larroy/mxnet,kevinthesun/mxnet,weleen/mxnet,precedenceguo/mxnet,formath/mxnet,sergeykolychev/mxnet,solin319/incubator-mxnet,madjam/mxnet,zhreshold/mxnet,sergeykolychev/mxnet,zhreshold/mxnet,jermainewang/mxnet,tlby/mxnet,weleen/mxnet,solin319/incubator-mxnet,madjam/mxnet,indhub/mxnet,navrasio/mxnet,ptrendx/mxnet,kevinthesun/mxnet,LinkHS/incubator-mxnet,ShownX/incubator-mxnet,Northrend/mxnet,crazy-cat/incubator-mxnet,antoan2/incubator-mxnet,CodingCat/mxnet,tornadomeet/mxnet,LinkHS/incubator-mxnet,TuSimple/mxnet,reminisce/mxnet,szha/mxnet,ykim362/mxnet,tornadomeet/mxnet,kkk669/mxnet,formath/mxnet,sxjscience/mxnet,tornadomeet/mxnet,sxjscience/mxnet,ForkedReposBak/mxnet,ShownX/incubator-mxnet,tlby/mxnet,vikingMei/mxnet,crazy-cat/incubator-mxnet,dmlc/mxnet,jennyzhang0215/incubator-mxnet,precedenceguo/mxnet,jennyzhang0215/incubator-mxnet,fullfanta/mxnet,TuSimple/mxnet,solin319/incubator-mxnet,reminisce/mxnet,kevinthesun/mxnet,ptrendx/mxnet,madjam/mxnet,Prasad9/incubator-mxnet,kkk669/mxnet,apache/incubator-mxnet,antoan2/incubator-mxnet,larroy/mxnet,ptrendx/mxnet,saurabh3949/mxnet,ShownX/incubator-mxnet,szha/mxnet,ykim362/mxnet,rahul003/mxnet,yuruofeifei/mxnet,luoyetx/mxnet,leezu/mxnet,zhreshold/mxnet,Northrend/mxnet,CodingCat/mxnet,LinkHS/incubator-mxnet,jiajiechen/mxnet,ShownX/incubator-mxnet,tlby/mxnet,ptrendx/mxnet,kevinthesun/mxnet,leezu/mxnet,yajiedesign/mxnet,wangyum/mxnet,leezu/mxnet,jennyzhang0215/incubator-mxnet,jamesliu/mxnet,jermainewang/mxnet,jermainewang/mxnet,crazy-cat/incubator-mxnet,mbaijal/incubator-mxnet,mbaijal/incubator-mxnet,Northrend/mxnet,piiswrong/mxnet,vikingMei/mxnet,ptrendx/mxnet,jamesliu/mxnet,madjam/mxnet,Prasad9/incubator-mxnet,yuruofeifei/mxnet,kkk669/mxnet,wangyum/mxnet,szha/mxnet,eric-haibin-lin/mxnet,luoyetx/mxnet,navrasio/mxnet,ZihengJiang/mxnet,rahul003/mxnet,leezu/mxnet,vikingMei/mxnet,weleen/mxnet,ZihengJiang/mxnet,ykim362/mxnet,TuSimple/mxnet,crazy-cat/incubator-mxnet,wangyum/mxnet,mbaijal/incubator-mxnet,indhub/mxnet,kevinthesun/mxnet,dmlc/mxnet,weleen/mxnet,indhub/mxnet,yajiedesign/mxnet,Mega-DatA-Lab/mxnet,reminisce/mxnet,hpi-xnor/BMXNet,kevinthesun/mxnet,ShownX/incubator-mxnet,tornadomeet/mxnet,mbaijal/incubator-mxnet,ForkedReposBak/mxnet,navrasio/mxnet,TuSimple/mxnet,Prasad9/incubator-mxnet,eric-haibin-lin/mxnet,rahul003/mxnet,luoyetx/mxnet,solin319/incubator-mxnet,apache/incubator-mxnet,piiswrong/mxnet,crazy-cat/incubator-mxnet,hpi-xnor/BMXNet,reminisce/mxnet,solin319/incubator-mxnet,Northrend/mxnet,Northrend/mxnet,jamesliu/mxnet,wangyum/mxnet,ptrendx/mxnet,jiajiechen/mxnet,luoyetx/mxnet,LinkHS/incubator-mxnet,hpi-xnor/BMXNet,precedenceguo/mxnet,dmlc/mxnet,yuruofeifei/mxnet,kevinthesun/mxnet,jiajiechen/mxnet,weleen/mxnet,jermainewang/mxnet,szha/mxnet,crazy-cat/incubator-mxnet,ykim362/mxnet,ShownX/incubator-mxnet,formath/mxnet,mbaijal/incubator-mxnet,jamesliu/mxnet,CodingCat/mxnet,CodingCat/mxnet,antoan2/incubator-mxnet,solin319/incubator-mxnet,jiajiechen/mxnet,tlby/mxnet,ykim362/mxnet,TuSimple/mxnet,CodingCat/mxnet,weleen/mxnet,zhreshold/mxnet,weleen/mxnet,kkk669/mxnet,Mega-DatA-Lab/mxnet,leezu/mxnet,kevinthesun/mxnet,sxjscience/mxnet,DickJC123/mxnet,szha/mxnet,larroy/mxnet,TuSimple/mxnet,eric-haibin-lin/mxnet,ForkedReposBak/mxnet,Prasad9/incubator-mxnet,smolix/incubator-mxnet,kkk669/mxnet,fullfanta/mxnet,ykim362/mxnet,yuruofeifei/mxnet,formath/mxnet,ptrendx/mxnet,formath/mxnet,hpi-xnor/BMXNet,yuruofeifei/mxnet,dmlc/mxnet,luoyetx/mxnet,luoyetx/mxnet,indhub/mxnet,antoan2/incubator-mxnet,precedenceguo/mxnet,kevinthesun/mxnet,jennyzhang0215/incubator-mxnet,leezu/mxnet,indhub/mxnet,szha/mxnet,mbaijal/incubator-mxnet,sergeykolychev/mxnet,smolix/incubator-mxnet,hpi-xnor/BMXNet,hpi-xnor/BMXNet,smolix/incubator-mxnet,Mega-DatA-Lab/mxnet,saurabh3949/mxnet,saurabh3949/mxnet,jiajiechen/mxnet,kkk669/mxnet,tlby/mxnet,jermainewang/mxnet,antoan2/incubator-mxnet,apache/incubator-mxnet,sergeykolychev/mxnet,wangyum/mxnet,wangyum/mxnet,smolix/incubator-mxnet,luoyetx/mxnet,Prasad9/incubator-mxnet,ZihengJiang/mxnet,jennyzhang0215/incubator-mxnet,antoan2/incubator-mxnet,yajiedesign/mxnet,saurabh3949/mxnet,madjam/mxnet,zhreshold/mxnet,sxjscience/mxnet,fullfanta/mxnet,ShownX/incubator-mxnet,tornadomeet/mxnet,larroy/mxnet,luoyetx/mxnet,Northrend/mxnet,Prasad9/incubator-mxnet,ForkedReposBak/mxnet,sergeykolychev/mxnet,indhub/mxnet,navrasio/mxnet,Mega-DatA-Lab/mxnet,saurabh3949/mxnet,reminisce/mxnet,jiajiechen/mxnet,mbaijal/incubator-mxnet,crazy-cat/incubator-mxnet,jiajiechen/mxnet,ZihengJiang/mxnet,eric-haibin-lin/mxnet,jermainewang/mxnet,sergeykolychev/mxnet,hpi-xnor/BMXNet,jennyzhang0215/incubator-mxnet,sergeykolychev/mxnet,rahul003/mxnet,crazy-cat/incubator-mxnet,sxjscience/mxnet,TuSimple/mxnet,piiswrong/mxnet,vikingMei/mxnet,jamesliu/mxnet,ZihengJiang/mxnet,piiswrong/mxnet,precedenceguo/mxnet,Prasad9/incubator-mxnet,jennyzhang0215/incubator-mxnet,eric-haibin-lin/mxnet,madjam/mxnet,piiswrong/mxnet,crazy-cat/incubator-mxnet,ForkedReposBak/mxnet,larroy/mxnet,formath/mxnet,ptrendx/mxnet,tlby/mxnet,eric-haibin-lin/mxnet,kkk669/mxnet,jiajiechen/mxnet,yuruofeifei/mxnet,zhreshold/mxnet,tornadomeet/mxnet,navrasio/mxnet,piiswrong/mxnet,larroy/mxnet,zhreshold/mxnet,solin319/incubator-mxnet,ForkedReposBak/mxnet,yajiedesign/mxnet,luoyetx/mxnet,CodingCat/mxnet,vikingMei/mxnet,formath/mxnet,saurabh3949/mxnet,kkk669/mxnet,CodingCat/mxnet,ShownX/incubator-mxnet,CodingCat/mxnet,jamesliu/mxnet,madjam/mxnet,vikingMei/mxnet,saurabh3949/mxnet,vikingMei/mxnet,tornadomeet/mxnet,sxjscience/mxnet,vikingMei/mxnet,Mega-DatA-Lab/mxnet,smolix/incubator-mxnet,ykim362/mxnet,tornadomeet/mxnet,DickJC123/mxnet,wangyum/mxnet,saurabh3949/mxnet,rahul003/mxnet,antoan2/incubator-mxnet,Prasad9/incubator-mxnet,antoan2/incubator-mxnet,jamesliu/mxnet,smolix/incubator-mxnet,TuSimple/mxnet,smolix/incubator-mxnet,reminisce/mxnet,madjam/mxnet,yajiedesign/mxnet,indhub/mxnet,ShownX/incubator-mxnet,yuruofeifei/mxnet,piiswrong/mxnet,reminisce/mxnet,solin319/incubator-mxnet,piiswrong/mxnet,yuruofeifei/mxnet,reminisce/mxnet,solin319/incubator-mxnet,reminisce/mxnet,szha/mxnet,ZihengJiang/mxnet,ZihengJiang/mxnet,jermainewang/mxnet,fullfanta/mxnet,jermainewang/mxnet,precedenceguo/mxnet,fullfanta/mxnet,Northrend/mxnet,sergeykolychev/mxnet,rahul003/mxnet,indhub/mxnet,ZihengJiang/mxnet,tlby/mxnet,ForkedReposBak/mxnet,dmlc/mxnet,jamesliu/mxnet,saurabh3949/mxnet,dmlc/mxnet,reminisce/mxnet,jermainewang/mxnet,mbaijal/incubator-mxnet,apache/incubator-mxnet,LinkHS/incubator-mxnet,eric-haibin-lin/mxnet,larroy/mxnet,wangyum/mxnet,yajiedesign/mxnet,TuSimple/mxnet,Prasad9/incubator-mxnet,precedenceguo/mxnet,precedenceguo/mxnet,sergeykolychev/mxnet,madjam/mxnet,tlby/mxnet,yajiedesign/mxnet,weleen/mxnet,dmlc/mxnet,szha/mxnet,navrasio/mxnet,CodingCat/mxnet