Fix unit test for test_loss.py (#7693)
Fix unit test for test_loss.py (#7693)

* Fix a typo

* update

* change variable name from defered_init to deferred_init

* change function name: test_defered_init -> test_deferred_init

* Add learning_rate and lr_scheduler properties and add setter for learning rate

* Update the learning_rate property and add property docstring in init

* Update the docstring

* Make learning rate getter/setter the concern of the optimizer

* Add space between words

* Update setters

* disable pylint complaint for too-many-lines

* Add more docstring explanations

* Patch for issues of hard to pass L1loss unittest

* Patch for test_loss unittest: already tested with 100 random test cases without seeds

* Important patch: replace all optimizers from sgd to adam.

* chmod back to 644

* revert changes to test_loss: will send a separate pr

* Patch for test_loss to reduce failure rate that is purely due to randomness: replace all sgd to adam

* patch for unittest: replace all sgds with adams

* revert optimizer

* add linebreak

yuruofeifei/mxnet,saurabh3949/mxnet,vikingMei/mxnet,navrasio/mxnet,jiajiechen/mxnet,antoan2/incubator-mxnet,solin319/incubator-mxnet,weleen/mxnet,weleen/mxnet,hpi-xnor/BMXNet,hpi-xnor/BMXNet,saurabh3949/mxnet,vikingMei/mxnet,ykim362/mxnet,indhub/mxnet,ShownX/incubator-mxnet,zhreshold/mxnet,fullfanta/mxnet,yajiedesign/mxnet,Mega-DatA-Lab/mxnet,ptrendx/mxnet,eric-haibin-lin/mxnet,piiswrong/mxnet,rahul003/mxnet,sergeykolychev/mxnet,fullfanta/mxnet,weleen/mxnet,LinkHS/incubator-mxnet,jiajiechen/mxnet,wangyum/mxnet,smolix/incubator-mxnet,ZihengJiang/mxnet,rahul003/mxnet,DickJC123/mxnet,antoan2/incubator-mxnet,szha/mxnet,ptrendx/mxnet,kevinthesun/mxnet,luoyetx/mxnet,precedenceguo/mxnet,jermainewang/mxnet,weleen/mxnet,formath/mxnet,ptrendx/mxnet,zhreshold/mxnet,DickJC123/mxnet,mbaijal/incubator-mxnet,tornadomeet/mxnet,leezu/mxnet,Northrend/mxnet,formath/mxnet,leezu/mxnet,tornadomeet/mxnet,Northrend/mxnet,CodingCat/mxnet,ykim362/mxnet,sxjscience/mxnet,hpi-xnor/BMXNet,kevinthesun/mxnet,rahul003/mxnet,weleen/mxnet,sergeykolychev/mxnet,wangyum/mxnet,luoyetx/mxnet,eric-haibin-lin/mxnet,dmlc/mxnet,Prasad9/incubator-mxnet,fullfanta/mxnet,Mega-DatA-Lab/mxnet,Prasad9/incubator-mxnet,crazy-cat/incubator-mxnet,smolix/incubator-mxnet,TuSimple/mxnet,leezu/mxnet,formath/mxnet,jamesliu/mxnet,mbaijal/incubator-mxnet,szha/mxnet,hpi-xnor/BMXNet,ForkedReposBak/mxnet,precedenceguo/mxnet,piiswrong/mxnet,hpi-xnor/BMXNet,Prasad9/incubator-mxnet,sergeykolychev/mxnet,reminisce/mxnet,indhub/mxnet,TuSimple/mxnet,Prasad9/incubator-mxnet,kevinthesun/mxnet,yuruofeifei/mxnet,sxjscience/mxnet,ZihengJiang/mxnet,crazy-cat/incubator-mxnet,larroy/mxnet,saurabh3949/mxnet,eric-haibin-lin/mxnet,leezu/mxnet,crazy-cat/incubator-mxnet,ptrendx/mxnet,smolix/incubator-mxnet,tornadomeet/mxnet,ykim362/mxnet,larroy/mxnet,sergeykolychev/mxnet,ZihengJiang/mxnet,szha/mxnet,larroy/mxnet,CodingCat/mxnet,ShownX/incubator-mxnet,leezu/mxnet,yajiedesign/mxnet,jennyzhang0215/incubator-mxnet,szha/mxnet,jamesliu/mxnet,ptrendx/mxnet,formath/mxnet,reminisce/mxnet,tornadomeet/mxnet,TuSimple/mxnet,wangyum/mxnet,ZihengJiang/mxnet,saurabh3949/mxnet,antoan2/incubator-mxnet,Northrend/mxnet,luoyetx/mxnet,eric-haibin-lin/mxnet,wangyum/mxnet,ForkedReposBak/mxnet,fullfanta/mxnet,yajiedesign/mxnet,sxjscience/mxnet,yuruofeifei/mxnet,piiswrong/mxnet,formath/mxnet,jermainewang/mxnet,Northrend/mxnet,TuSimple/mxnet,yuruofeifei/mxnet,dmlc/mxnet,yuruofeifei/mxnet,sxjscience/mxnet,Mega-DatA-Lab/mxnet,indhub/mxnet,smolix/incubator-mxnet,dmlc/mxnet,reminisce/mxnet,zhreshold/mxnet,ShownX/incubator-mxnet,Northrend/mxnet,jiajiechen/mxnet,mbaijal/incubator-mxnet,LinkHS/incubator-mxnet,tlby/mxnet,solin319/incubator-mxnet,kkk669/mxnet,jermainewang/mxnet,indhub/mxnet,sergeykolychev/mxnet,tornadomeet/mxnet,szha/mxnet,indhub/mxnet,luoyetx/mxnet,mbaijal/incubator-mxnet,jamesliu/mxnet,kkk669/mxnet,wangyum/mxnet,indhub/mxnet,szha/mxnet,reminisce/mxnet,solin319/incubator-mxnet,fullfanta/mxnet,kkk669/mxnet,solin319/incubator-mxnet,jiajiechen/mxnet,CodingCat/mxnet,jennyzhang0215/incubator-mxnet,jennyzhang0215/incubator-mxnet,tlby/mxnet,navrasio/mxnet,crazy-cat/incubator-mxnet,kkk669/mxnet,kkk669/mxnet,saurabh3949/mxnet,leezu/mxnet,dmlc/mxnet,jamesliu/mxnet,eric-haibin-lin/mxnet,szha/mxnet,jennyzhang0215/incubator-mxnet,luoyetx/mxnet,ptrendx/mxnet,ptrendx/mxnet,ShownX/incubator-mxnet,jamesliu/mxnet,ShownX/incubator-mxnet,tlby/mxnet,LinkHS/incubator-mxnet,saurabh3949/mxnet,jermainewang/mxnet,jennyzhang0215/incubator-mxnet,mbaijal/incubator-mxnet,eric-haibin-lin/mxnet,hpi-xnor/BMXNet,vikingMei/mxnet,reminisce/mxnet,yuruofeifei/mxnet,Prasad9/incubator-mxnet,rahul003/mxnet,vikingMei/mxnet,antoan2/incubator-mxnet,smolix/incubator-mxnet,formath/mxnet,jiajiechen/mxnet,Prasad9/incubator-mxnet,navrasio/mxnet,ykim362/mxnet,rahul003/mxnet,precedenceguo/mxnet,LinkHS/incubator-mxnet,jiajiechen/mxnet,Mega-DatA-Lab/mxnet,kkk669/mxnet,indhub/mxnet,yajiedesign/mxnet,jennyzhang0215/incubator-mxnet,dmlc/mxnet,yajiedesign/mxnet,ykim362/mxnet,dmlc/mxnet,mbaijal/incubator-mxnet,weleen/mxnet,yajiedesign/mxnet,ZihengJiang/mxnet,precedenceguo/mxnet,saurabh3949/mxnet,dmlc/mxnet,mbaijal/incubator-mxnet,tornadomeet/mxnet,ForkedReposBak/mxnet,solin319/incubator-mxnet,madjam/mxnet,zhreshold/mxnet,Mega-DatA-Lab/mxnet,ForkedReposBak/mxnet,antoan2/incubator-mxnet,yuruofeifei/mxnet,tornadomeet/mxnet,luoyetx/mxnet,apache/incubator-mxnet,ZihengJiang/mxnet,ZihengJiang/mxnet,jermainewang/mxnet,navrasio/mxnet,madjam/mxnet,vikingMei/mxnet,jamesliu/mxnet,wangyum/mxnet,madjam/mxnet,hpi-xnor/BMXNet,Mega-DatA-Lab/mxnet,navrasio/mxnet,LinkHS/incubator-mxnet,navrasio/mxnet,luoyetx/mxnet,zhreshold/mxnet,kevinthesun/mxnet,Mega-DatA-Lab/mxnet,kevinthesun/mxnet,sxjscience/mxnet,jamesliu/mxnet,hpi-xnor/BMXNet,dmlc/mxnet,larroy/mxnet,madjam/mxnet,Northrend/mxnet,ptrendx/mxnet,reminisce/mxnet,ZihengJiang/mxnet,apache/incubator-mxnet,saurabh3949/mxnet,ptrendx/mxnet,smolix/incubator-mxnet,DickJC123/mxnet,solin319/incubator-mxnet,leezu/mxnet,madjam/mxnet,indhub/mxnet,apache/incubator-mxnet,madjam/mxnet,zhreshold/mxnet,jennyzhang0215/incubator-mxnet,sxjscience/mxnet,wangyum/mxnet,zhreshold/mxnet,ForkedReposBak/mxnet,CodingCat/mxnet,kevinthesun/mxnet,saurabh3949/mxnet,formath/mxnet,kevinthesun/mxnet,kevinthesun/mxnet,zhreshold/mxnet,szha/mxnet,sergeykolychev/mxnet,LinkHS/incubator-mxnet,indhub/mxnet,crazy-cat/incubator-mxnet,jiajiechen/mxnet,jermainewang/mxnet,jermainewang/mxnet,fullfanta/mxnet,jermainewang/mxnet,Mega-DatA-Lab/mxnet,ShownX/incubator-mxnet,sergeykolychev/mxnet,szha/mxnet,vikingMei/mxnet,antoan2/incubator-mxnet,TuSimple/mxnet,ykim362/mxnet,piiswrong/mxnet,crazy-cat/incubator-mxnet,antoan2/incubator-mxnet,solin319/incubator-mxnet,sxjscience/mxnet,piiswrong/mxnet,precedenceguo/mxnet,formath/mxnet,eric-haibin-lin/mxnet,tornadomeet/mxnet,LinkHS/incubator-mxnet,ForkedReposBak/mxnet,yuruofeifei/mxnet,mbaijal/incubator-mxnet,ykim362/mxnet,precedenceguo/mxnet,jamesliu/mxnet,yajiedesign/mxnet,smolix/incubator-mxnet,ShownX/incubator-mxnet,luoyetx/mxnet,sergeykolychev/mxnet,Prasad9/incubator-mxnet,TuSimple/mxnet,rahul003/mxnet,CodingCat/mxnet,Northrend/mxnet,sergeykolychev/mxnet,madjam/mxnet,larroy/mxnet,jamesliu/mxnet,eric-haibin-lin/mxnet,eric-haibin-lin/mxnet,piiswrong/mxnet,ShownX/incubator-mxnet,reminisce/mxnet,kkk669/mxnet,yuruofeifei/mxnet,Prasad9/incubator-mxnet,tlby/mxnet,ptrendx/mxnet,yajiedesign/mxnet,weleen/mxnet,tornadomeet/mxnet,tlby/mxnet,CodingCat/mxnet,navrasio/mxnet,jennyzhang0215/incubator-mxnet,vikingMei/mxnet,weleen/mxnet,CodingCat/mxnet,ShownX/incubator-mxnet,dmlc/mxnet,rahul003/mxnet,TuSimple/mxnet,piiswrong/mxnet,leezu/mxnet,ykim362/mxnet,fullfanta/mxnet,luoyetx/mxnet,precedenceguo/mxnet,crazy-cat/incubator-mxnet,ZihengJiang/mxnet,larroy/mxnet,tlby/mxnet,solin319/incubator-mxnet,smolix/incubator-mxnet,madjam/mxnet,kevinthesun/mxnet,antoan2/incubator-mxnet,tlby/mxnet,LinkHS/incubator-mxnet,vikingMei/mxnet,fullfanta/mxnet,larroy/mxnet,navrasio/mxnet,hpi-xnor/BMXNet,jermainewang/mxnet,crazy-cat/incubator-mxnet,rahul003/mxnet,solin319/incubator-mxnet,Northrend/mxnet,DickJC123/mxnet,wangyum/mxnet,mbaijal/incubator-mxnet,jiajiechen/mxnet,LinkHS/incubator-mxnet,TuSimple/mxnet,reminisce/mxnet,madjam/mxnet,kkk669/mxnet,Northrend/mxnet,ForkedReposBak/mxnet,larroy/mxnet,tlby/mxnet,wangyum/mxnet,precedenceguo/mxnet,precedenceguo/mxnet,antoan2/incubator-mxnet,navrasio/mxnet,Prasad9/incubator-mxnet,piiswrong/mxnet,rahul003/mxnet,reminisce/mxnet,CodingCat/mxnet,ForkedReposBak/mxnet,weleen/mxnet,formath/mxnet,kkk669/mxnet,CodingCat/mxnet,leezu/mxnet,ykim362/mxnet,jiajiechen/mxnet,ForkedReposBak/mxnet,sxjscience/mxnet,Mega-DatA-Lab/mxnet,vikingMei/mxnet,apache/incubator-mxnet,fullfanta/mxnet,crazy-cat/incubator-mxnet,smolix/incubator-mxnet,piiswrong/mxnet,reminisce/mxnet,larroy/mxnet,TuSimple/mxnet,sxjscience/mxnet,tlby/mxnet,zhreshold/mxnet,jennyzhang0215/incubator-mxnet,TuSimple/mxnet,tlby/mxnet,yajiedesign/mxnet