MKL DNN: fix the TF1.6 speed issue by fixing MKL DNN LRN taking the optimum path (#17605) (#17751)
MKL DNN: fix the TF1.6 speed issue by fixing MKL DNN LRN taking the optimum path (#17605) (#17751)

* MKL DNN: fix the TF1.6 speed issue by fixing MKL DNN LRN

* fixed typos in the doc for LrnRewrite
ageron/tensorflow,dancingdan/tensorflow,Xeralux/tensorflow,gautam1858/tensorflow,nburn42/tensorflow,allenlavoie/tensorflow,jendap/tensorflow,adit-chandra/tensorflow,benoitsteiner/tensorflow-xsmm,snnn/tensorflow,chemelnucfin/tensorflow,gautam1858/tensorflow,brchiu/tensorflow,alshedivat/tensorflow,xodus7/tensorflow,theflofly/tensorflow,renyi533/tensorflow,annarev/tensorflow,adit-chandra/tensorflow,Intel-tensorflow/tensorflow,AnishShah/tensorflow,renyi533/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Xeralux/tensorflow,ageron/tensorflow,dongjoon-hyun/tensorflow,dendisuhubdy/tensorflow,Intel-tensorflow/tensorflow,dancingdan/tensorflow,kevin-coder/tensorflow-fork,paolodedios/tensorflow,adit-chandra/tensorflow,tensorflow/tensorflow,brchiu/tensorflow,ppwwyyxx/tensorflow,lukeiwanski/tensorflow,freedomtan/tensorflow,manipopopo/tensorflow,brchiu/tensorflow,gautam1858/tensorflow,kevin-coder/tensorflow-fork,adit-chandra/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,karllessard/tensorflow,Bismarrck/tensorflow,annarev/tensorflow,seanli9jan/tensorflow,apark263/tensorflow,dongjoon-hyun/tensorflow,kobejean/tensorflow,Bismarrck/tensorflow,DavidNorman/tensorflow,paolodedios/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,renyi533/tensorflow,ppwwyyxx/tensorflow,gautam1858/tensorflow,xodus7/tensorflow,drpngx/tensorflow,freedomtan/tensorflow,DavidNorman/tensorflow,alsrgv/tensorflow,benoitsteiner/tensorflow-xsmm,xodus7/tensorflow,ZhangXinNan/tensorflow,alshedivat/tensorflow,brchiu/tensorflow,ZhangXinNan/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_saved_model,alshedivat/tensorflow,annarev/tensorflow,tensorflow/tensorflow-pywrap_saved_model,hehongliang/tensorflow,benoitsteiner/tensorflow-xsmm,jalexvig/tensorflow,allenlavoie/tensorflow,theflofly/tensorflow,davidzchen/tensorflow,adit-chandra/tensorflow,gojira/tensorflow,caisq/tensorflow,tensorflow/tensorflow,jendap/tensorflow,ZhangXinNan/tensorflow,sarvex/tensorflow,yanchen036/tensorflow,aam-at/tensorflow,alshedivat/tensorflow,theflofly/tensorflow,kevin-coder/tensorflow-fork,davidzchen/tensorflow,Bismarrck/tensorflow,jbedorf/tensorflow,manipopopo/tensorflow,petewarden/tensorflow,arborh/tensorflow,dendisuhubdy/tensorflow,karllessard/tensorflow,sarvex/tensorflow,petewarden/tensorflow,aldian/tensorflow,aselle/tensorflow,jendap/tensorflow,brchiu/tensorflow,xodus7/tensorflow,asimshankar/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow-experimental_link_static_libraries_once,adit-chandra/tensorflow,jendap/tensorflow,theflofly/tensorflow,yongtang/tensorflow,renyi533/tensorflow,jart/tensorflow,ageron/tensorflow,dongjoon-hyun/tensorflow,aselle/tensorflow,Intel-tensorflow/tensorflow,kobejean/tensorflow,hehongliang/tensorflow,chemelnucfin/tensorflow,dancingdan/tensorflow,chemelnucfin/tensorflow,kevin-coder/tensorflow-fork,aselle/tensorflow,eaplatanios/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,seanli9jan/tensorflow,gunan/tensorflow,AnishShah/tensorflow,xzturn/tensorflow,renyi533/tensorflow,gojira/tensorflow,DavidNorman/tensorflow,asimshankar/tensorflow,Intel-tensorflow/tensorflow,apark263/tensorflow,annarev/tensorflow,gojira/tensorflow,tensorflow/tensorflow-pywrap_saved_model,paolodedios/tensorflow,jart/tensorflow,ppwwyyxx/tensorflow,lukeiwanski/tensorflow,meteorcloudy/tensorflow,drpngx/tensorflow,drpngx/tensorflow,davidzchen/tensorflow,nburn42/tensorflow,snnn/tensorflow,jbedorf/tensorflow,Bismarrck/tensorflow,davidzchen/tensorflow,cxxgtxy/tensorflow,DavidNorman/tensorflow,annarev/tensorflow,ageron/tensorflow,karllessard/tensorflow,jbedorf/tensorflow,Intel-tensorflow/tensorflow,kobejean/tensorflow,girving/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-experimental_link_static_libraries_once,hfp/tensorflow-xsmm,freedomtan/tensorflow,dendisuhubdy/tensorflow,nburn42/tensorflow,brchiu/tensorflow,gautam1858/tensorflow,dongjoon-hyun/tensorflow,renyi533/tensorflow,ppwwyyxx/tensorflow,benoitsteiner/tensorflow-xsmm,davidzchen/tensorflow,karllessard/tensorflow,adit-chandra/tensorflow,aselle/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,meteorcloudy/tensorflow,drpngx/tensorflow,Intel-tensorflow/tensorflow,petewarden/tensorflow,AnishShah/tensorflow,arborh/tensorflow,arborh/tensorflow,cxxgtxy/tensorflow,yanchen036/tensorflow,AnishShah/tensorflow,snnn/tensorflow,chemelnucfin/tensorflow,yanchen036/tensorflow,girving/tensorflow,jbedorf/tensorflow,gojira/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,lukeiwanski/tensorflow,tensorflow/tensorflow-pywrap_saved_model,davidzchen/tensorflow,aldian/tensorflow,theflofly/tensorflow,dendisuhubdy/tensorflow,hfp/tensorflow-xsmm,aldian/tensorflow,hfp/tensorflow-xsmm,asimshankar/tensorflow,jart/tensorflow,alsrgv/tensorflow,asimshankar/tensorflow,freedomtan/tensorflow,cxxgtxy/tensorflow,seanli9jan/tensorflow,alsrgv/tensorflow,Intel-tensorflow/tensorflow,ageron/tensorflow,jhseu/tensorflow,sarvex/tensorflow,brchiu/tensorflow,gautam1858/tensorflow,lukeiwanski/tensorflow,Bismarrck/tensorflow,kevin-coder/tensorflow-fork,seanli9jan/tensorflow,Bismarrck/tensorflow,dongjoon-hyun/tensorflow,jendap/tensorflow,Intel-Corporation/tensorflow,dendisuhubdy/tensorflow,jart/tensorflow,dancingdan/tensorflow,yongtang/tensorflow,paolodedios/tensorflow,Intel-tensorflow/tensorflow,sarvex/tensorflow,eaplatanios/tensorflow,manipopopo/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aldian/tensorflow,petewarden/tensorflow,frreiss/tensorflow-fred,meteorcloudy/tensorflow,hfp/tensorflow-xsmm,chemelnucfin/tensorflow,karllessard/tensorflow,ghchinoy/tensorflow,lukeiwanski/tensorflow,yanchen036/tensorflow,ghchinoy/tensorflow,gunan/tensorflow,AnishShah/tensorflow,gunan/tensorflow,drpngx/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jbedorf/tensorflow,jendap/tensorflow,karllessard/tensorflow,benoitsteiner/tensorflow-xsmm,tensorflow/tensorflow-experimental_link_static_libraries_once,caisq/tensorflow,tensorflow/tensorflow,xodus7/tensorflow,jhseu/tensorflow,benoitsteiner/tensorflow-xsmm,aselle/tensorflow,xzturn/tensorflow,drpngx/tensorflow,theflofly/tensorflow,ghchinoy/tensorflow,paolodedios/tensorflow,freedomtan/tensorflow,xodus7/tensorflow,eaplatanios/tensorflow,alsrgv/tensorflow,brchiu/tensorflow,Xeralux/tensorflow,apark263/tensorflow,ageron/tensorflow,adit-chandra/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,hfp/tensorflow-xsmm,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,allenlavoie/tensorflow,alsrgv/tensorflow,Bismarrck/tensorflow,aldian/tensorflow,jalexvig/tensorflow,arborh/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow,jalexvig/tensorflow,petewarden/tensorflow,chemelnucfin/tensorflow,caisq/tensorflow,frreiss/tensorflow-fred,allenlavoie/tensorflow,dancingdan/tensorflow,gunan/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,girving/tensorflow,gunan/tensorflow,aselle/tensorflow,manipopopo/tensorflow,theflofly/tensorflow,jhseu/tensorflow,yanchen036/tensorflow,alshedivat/tensorflow,drpngx/tensorflow,nburn42/tensorflow,jhseu/tensorflow,jbedorf/tensorflow,Intel-Corporation/tensorflow,cxxgtxy/tensorflow,annarev/tensorflow,dancingdan/tensorflow,jhseu/tensorflow,xodus7/tensorflow,gojira/tensorflow,xodus7/tensorflow,aam-at/tensorflow,ppwwyyxx/tensorflow,hfp/tensorflow-xsmm,manipopopo/tensorflow,Intel-Corporation/tensorflow,renyi533/tensorflow,ageron/tensorflow,girving/tensorflow,hfp/tensorflow-xsmm,brchiu/tensorflow,ZhangXinNan/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kobejean/tensorflow,chemelnucfin/tensorflow,Xeralux/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,ghchinoy/tensorflow,dendisuhubdy/tensorflow,Xeralux/tensorflow,jendap/tensorflow,hehongliang/tensorflow,freedomtan/tensorflow,annarev/tensorflow,Xeralux/tensorflow,paolodedios/tensorflow,ageron/tensorflow,jendap/tensorflow,girving/tensorflow,karllessard/tensorflow,tensorflow/tensorflow,frreiss/tensorflow-fred,gunan/tensorflow,petewarden/tensorflow,apark263/tensorflow,benoitsteiner/tensorflow-xsmm,snnn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,alsrgv/tensorflow,brchiu/tensorflow,yongtang/tensorflow,manipopopo/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,ghchinoy/tensorflow,ppwwyyxx/tensorflow,sarvex/tensorflow,AnishShah/tensorflow,ageron/tensorflow,freedomtan/tensorflow,DavidNorman/tensorflow,seanli9jan/tensorflow,jhseu/tensorflow,jalexvig/tensorflow,tensorflow/tensorflow-pywrap_saved_model,AnishShah/tensorflow,arborh/tensorflow,brchiu/tensorflow,apark263/tensorflow,caisq/tensorflow,seanli9jan/tensorflow,manipopopo/tensorflow,DavidNorman/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow,ageron/tensorflow,hehongliang/tensorflow,ZhangXinNan/tensorflow,aam-at/tensorflow,aselle/tensorflow,petewarden/tensorflow,cxxgtxy/tensorflow,yanchen036/tensorflow,manipopopo/tensorflow,kobejean/tensorflow,adit-chandra/tensorflow,xzturn/tensorflow,jalexvig/tensorflow,aldian/tensorflow,gunan/tensorflow,gunan/tensorflow,hehongliang/tensorflow,petewarden/tensorflow,eaplatanios/tensorflow,hfp/tensorflow-xsmm,apark263/tensorflow,dancingdan/tensorflow,manipopopo/tensorflow,ppwwyyxx/tensorflow,theflofly/tensorflow,Xeralux/tensorflow,renyi533/tensorflow,petewarden/tensorflow,gojira/tensorflow,aam-at/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ppwwyyxx/tensorflow,ZhangXinNan/tensorflow,jart/tensorflow,asimshankar/tensorflow,alsrgv/tensorflow,frreiss/tensorflow-fred,jbedorf/tensorflow,chemelnucfin/tensorflow,kobejean/tensorflow,aam-at/tensorflow,arborh/tensorflow,nburn42/tensorflow,arborh/tensorflow,meteorcloudy/tensorflow,arborh/tensorflow,gojira/tensorflow,alsrgv/tensorflow,sarvex/tensorflow,paolodedios/tensorflow,allenlavoie/tensorflow,benoitsteiner/tensorflow-xsmm,sarvex/tensorflow,chemelnucfin/tensorflow,xzturn/tensorflow,eaplatanios/tensorflow,AnishShah/tensorflow,jendap/tensorflow,xodus7/tensorflow,Bismarrck/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,jart/tensorflow,xzturn/tensorflow,frreiss/tensorflow-fred,aselle/tensorflow,gunan/tensorflow,tensorflow/tensorflow,nburn42/tensorflow,kevin-coder/tensorflow-fork,gautam1858/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow,snnn/tensorflow,gautam1858/tensorflow,ZhangXinNan/tensorflow,davidzchen/tensorflow,Bismarrck/tensorflow,dendisuhubdy/tensorflow,renyi533/tensorflow,apark263/tensorflow,nburn42/tensorflow,tensorflow/tensorflow,arborh/tensorflow,snnn/tensorflow,ZhangXinNan/tensorflow,theflofly/tensorflow,caisq/tensorflow,jart/tensorflow,caisq/tensorflow,meteorcloudy/tensorflow,gautam1858/tensorflow,xodus7/tensorflow,ghchinoy/tensorflow,davidzchen/tensorflow,asimshankar/tensorflow,yongtang/tensorflow,jbedorf/tensorflow,frreiss/tensorflow-fred,adit-chandra/tensorflow,seanli9jan/tensorflow,alshedivat/tensorflow,jalexvig/tensorflow,ZhangXinNan/tensorflow,ghchinoy/tensorflow,jhseu/tensorflow,Xeralux/tensorflow,asimshankar/tensorflow,karllessard/tensorflow,dancingdan/tensorflow,allenlavoie/tensorflow,girving/tensorflow,paolodedios/tensorflow,jendap/tensorflow,AnishShah/tensorflow,chemelnucfin/tensorflow,asimshankar/tensorflow,drpngx/tensorflow,theflofly/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,davidzchen/tensorflow,gojira/tensorflow,frreiss/tensorflow-fred,xzturn/tensorflow,karllessard/tensorflow,jendap/tensorflow,alsrgv/tensorflow,xzturn/tensorflow,theflofly/tensorflow,Bismarrck/tensorflow,kobejean/tensorflow,aam-at/tensorflow,snnn/tensorflow,freedomtan/tensorflow,jbedorf/tensorflow,yongtang/tensorflow,yongtang/tensorflow,snnn/tensorflow,kevin-coder/tensorflow-fork,jhseu/tensorflow,AnishShah/tensorflow,jalexvig/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aldian/tensorflow,arborh/tensorflow,Intel-Corporation/tensorflow,xzturn/tensorflow,jalexvig/tensorflow,gojira/tensorflow,annarev/tensorflow,paolodedios/tensorflow,benoitsteiner/tensorflow-xsmm,caisq/tensorflow,Intel-Corporation/tensorflow,jbedorf/tensorflow,jbedorf/tensorflow,adit-chandra/tensorflow,nburn42/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,alsrgv/tensorflow,renyi533/tensorflow,gunan/tensorflow,lukeiwanski/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-pywrap_tf_optimizer,snnn/tensorflow,davidzchen/tensorflow,seanli9jan/tensorflow,frreiss/tensorflow-fred,jhseu/tensorflow,asimshankar/tensorflow,freedomtan/tensorflow,ageron/tensorflow,xzturn/tensorflow,nburn42/tensorflow,caisq/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,theflofly/tensorflow,Xeralux/tensorflow,kevin-coder/tensorflow-fork,dendisuhubdy/tensorflow,annarev/tensorflow,gunan/tensorflow,girving/tensorflow,aam-at/tensorflow,lukeiwanski/tensorflow,eaplatanios/tensorflow,drpngx/tensorflow,kobejean/tensorflow,hfp/tensorflow-xsmm,DavidNorman/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,girving/tensorflow,jalexvig/tensorflow,eaplatanios/tensorflow,dongjoon-hyun/tensorflow,chemelnucfin/tensorflow,annarev/tensorflow,jbedorf/tensorflow,caisq/tensorflow,chemelnucfin/tensorflow,caisq/tensorflow,tensorflow/tensorflow-pywrap_saved_model,seanli9jan/tensorflow,renyi533/tensorflow,aselle/tensorflow,ppwwyyxx/tensorflow,drpngx/tensorflow,eaplatanios/tensorflow,alshedivat/tensorflow,dongjoon-hyun/tensorflow,dancingdan/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,DavidNorman/tensorflow,yanchen036/tensorflow,allenlavoie/tensorflow,benoitsteiner/tensorflow-xsmm,paolodedios/tensorflow,jart/tensorflow,hehongliang/tensorflow,kobejean/tensorflow,meteorcloudy/tensorflow,girving/tensorflow,gojira/tensorflow,renyi533/tensorflow,lukeiwanski/tensorflow,jalexvig/tensorflow,DavidNorman/tensorflow,yongtang/tensorflow,aselle/tensorflow,frreiss/tensorflow-fred,alshedivat/tensorflow,meteorcloudy/tensorflow,yongtang/tensorflow,gautam1858/tensorflow,girving/tensorflow,Xeralux/tensorflow,meteorcloudy/tensorflow,ZhangXinNan/tensorflow,lukeiwanski/tensorflow,aselle/tensorflow,ageron/tensorflow,dongjoon-hyun/tensorflow,dendisuhubdy/tensorflow,manipopopo/tensorflow,ZhangXinNan/tensorflow,alshedivat/tensorflow,yongtang/tensorflow,allenlavoie/tensorflow,freedomtan/tensorflow,ppwwyyxx/tensorflow,jhseu/tensorflow,kobejean/tensorflow,kevin-coder/tensorflow-fork,snnn/tensorflow,benoitsteiner/tensorflow-xsmm,frreiss/tensorflow-fred,apark263/tensorflow,aldian/tensorflow,gojira/tensorflow,apark263/tensorflow,sarvex/tensorflow,AnishShah/tensorflow,ghchinoy/tensorflow,meteorcloudy/tensorflow,asimshankar/tensorflow,kevin-coder/tensorflow-fork,snnn/tensorflow,jart/tensorflow,jalexvig/tensorflow,jart/tensorflow,ghchinoy/tensorflow,allenlavoie/tensorflow,ppwwyyxx/tensorflow,seanli9jan/tensorflow,ghchinoy/tensorflow,Xeralux/tensorflow,kevin-coder/tensorflow-fork,petewarden/tensorflow,aam-at/tensorflow,apark263/tensorflow,adit-chandra/tensorflow,alsrgv/tensorflow,DavidNorman/tensorflow,lukeiwanski/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,arborh/tensorflow,kobejean/tensorflow,aam-at/tensorflow,eaplatanios/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,cxxgtxy/tensorflow,manipopopo/tensorflow,arborh/tensorflow,karllessard/tensorflow,DavidNorman/tensorflow,alshedivat/tensorflow,dongjoon-hyun/tensorflow,Intel-Corporation/tensorflow,xzturn/tensorflow,dongjoon-hyun/tensorflow,frreiss/tensorflow-fred,yongtang/tensorflow,nburn42/tensorflow,alshedivat/tensorflow,aam-at/tensorflow,tensorflow/tensorflow,allenlavoie/tensorflow,apark263/tensorflow,hehongliang/tensorflow,meteorcloudy/tensorflow,nburn42/tensorflow,dongjoon-hyun/tensorflow,jhseu/tensorflow,hfp/tensorflow-xsmm,allenlavoie/tensorflow,dendisuhubdy/tensorflow,yongtang/tensorflow,Intel-Corporation/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,paolodedios/tensorflow,cxxgtxy/tensorflow,Bismarrck/tensorflow,girving/tensorflow,annarev/tensorflow,eaplatanios/tensorflow,eaplatanios/tensorflow,ghchinoy/tensorflow,xodus7/tensorflow,yanchen036/tensorflow,aam-at/tensorflow