Improve fast_tensor_util for bfloat16
Improve fast_tensor_util for bfloat16

In 19180, improvement has been done to speed up the
fast_tensor_util for `float16`. As both `float16`
and `bfloat16` uses the same size, `bfloat16`
could be improved as well. This fix speeds up `bfloat16`
in a similiar fashion as `float16`.

This fix is related to 19180.

Signed-off-by: Yong Tang <765086fe2e0c1f980161f127fec596800f327f62@outlook.com>

tensorflow/tensorflow-pywrap_tf_optimizer,arborh/tensorflow,snnn/tensorflow,kobejean/tensorflow,xodus7/tensorflow,kevin-coder/tensorflow-fork,manipopopo/tensorflow,alsrgv/tensorflow,kevin-coder/tensorflow-fork,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,gunan/tensorflow,aldian/tensorflow,gunan/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,Bismarrck/tensorflow,manipopopo/tensorflow,Intel-Corporation/tensorflow,adit-chandra/tensorflow,tensorflow/tensorflow-pywrap_saved_model,dancingdan/tensorflow,adit-chandra/tensorflow,gunan/tensorflow,annarev/tensorflow,arborh/tensorflow,hfp/tensorflow-xsmm,gunan/tensorflow,karllessard/tensorflow,gunan/tensorflow,arborh/tensorflow,hfp/tensorflow-xsmm,freedomtan/tensorflow,yongtang/tensorflow,aselle/tensorflow,gunan/tensorflow,renyi533/tensorflow,snnn/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,snnn/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_tf_optimizer,ZhangXinNan/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,petewarden/tensorflow,kobejean/tensorflow,girving/tensorflow,davidzchen/tensorflow,sarvex/tensorflow,DavidNorman/tensorflow,arborh/tensorflow,Intel-tensorflow/tensorflow,Bismarrck/tensorflow,adit-chandra/tensorflow,manipopopo/tensorflow,jhseu/tensorflow,ghchinoy/tensorflow,DavidNorman/tensorflow,gunan/tensorflow,renyi533/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,kevin-coder/tensorflow-fork,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,karllessard/tensorflow,petewarden/tensorflow,ppwwyyxx/tensorflow,yongtang/tensorflow,jalexvig/tensorflow,tensorflow/tensorflow,manipopopo/tensorflow,seanli9jan/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow-experimental_link_static_libraries_once,jbedorf/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,brchiu/tensorflow,arborh/tensorflow,apark263/tensorflow,jhseu/tensorflow,DavidNorman/tensorflow,xodus7/tensorflow,seanli9jan/tensorflow,adit-chandra/tensorflow,snnn/tensorflow,hehongliang/tensorflow,dongjoon-hyun/tensorflow,jalexvig/tensorflow,yongtang/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-pywrap_saved_model,aselle/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,cxxgtxy/tensorflow,kobejean/tensorflow,annarev/tensorflow,tensorflow/tensorflow,girving/tensorflow,brchiu/tensorflow,jhseu/tensorflow,arborh/tensorflow,arborh/tensorflow,alshedivat/tensorflow,jendap/tensorflow,manipopopo/tensorflow,adit-chandra/tensorflow,davidzchen/tensorflow,apark263/tensorflow,Bismarrck/tensorflow,ghchinoy/tensorflow,frreiss/tensorflow-fred,karllessard/tensorflow,sarvex/tensorflow,DavidNorman/tensorflow,AnishShah/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,Bismarrck/tensorflow,sarvex/tensorflow,renyi533/tensorflow,davidzchen/tensorflow,sarvex/tensorflow,paolodedios/tensorflow,kevin-coder/tensorflow-fork,petewarden/tensorflow,jendap/tensorflow,alshedivat/tensorflow,adit-chandra/tensorflow,Intel-Corporation/tensorflow,snnn/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow,ageron/tensorflow,girving/tensorflow,jalexvig/tensorflow,seanli9jan/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kevin-coder/tensorflow-fork,ppwwyyxx/tensorflow,petewarden/tensorflow,aam-at/tensorflow,dancingdan/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_saved_model,paolodedios/tensorflow,ZhangXinNan/tensorflow,hfp/tensorflow-xsmm,aam-at/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,dancingdan/tensorflow,frreiss/tensorflow-fred,ageron/tensorflow,jhseu/tensorflow,davidzchen/tensorflow,snnn/tensorflow,adit-chandra/tensorflow,jendap/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,frreiss/tensorflow-fred,dongjoon-hyun/tensorflow,yongtang/tensorflow,karllessard/tensorflow,karllessard/tensorflow,dongjoon-hyun/tensorflow,ageron/tensorflow,alsrgv/tensorflow,ghchinoy/tensorflow,AnishShah/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,asimshankar/tensorflow,xodus7/tensorflow,ghchinoy/tensorflow,jhseu/tensorflow,xzturn/tensorflow,xodus7/tensorflow,dongjoon-hyun/tensorflow,gunan/tensorflow,jhseu/tensorflow,seanli9jan/tensorflow,freedomtan/tensorflow,karllessard/tensorflow,ppwwyyxx/tensorflow,aldian/tensorflow,brchiu/tensorflow,adit-chandra/tensorflow,xzturn/tensorflow,ageron/tensorflow,snnn/tensorflow,girving/tensorflow,cxxgtxy/tensorflow,theflofly/tensorflow,alshedivat/tensorflow,ppwwyyxx/tensorflow,renyi533/tensorflow,annarev/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,dongjoon-hyun/tensorflow,kevin-coder/tensorflow-fork,asimshankar/tensorflow,paolodedios/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,jendap/tensorflow,chemelnucfin/tensorflow,ZhangXinNan/tensorflow,hfp/tensorflow-xsmm,gautam1858/tensorflow,hfp/tensorflow-xsmm,cxxgtxy/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aselle/tensorflow,aam-at/tensorflow,kevin-coder/tensorflow-fork,kevin-coder/tensorflow-fork,frreiss/tensorflow-fred,snnn/tensorflow,ZhangXinNan/tensorflow,kobejean/tensorflow,gunan/tensorflow,alshedivat/tensorflow,girving/tensorflow,dancingdan/tensorflow,seanli9jan/tensorflow,ppwwyyxx/tensorflow,theflofly/tensorflow,alsrgv/tensorflow,gautam1858/tensorflow,jbedorf/tensorflow,ZhangXinNan/tensorflow,annarev/tensorflow,jendap/tensorflow,davidzchen/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,adit-chandra/tensorflow,annarev/tensorflow,chemelnucfin/tensorflow,brchiu/tensorflow,Intel-Corporation/tensorflow,Intel-tensorflow/tensorflow,AnishShah/tensorflow,paolodedios/tensorflow,jalexvig/tensorflow,adit-chandra/tensorflow,manipopopo/tensorflow,asimshankar/tensorflow,renyi533/tensorflow,jalexvig/tensorflow,freedomtan/tensorflow,frreiss/tensorflow-fred,ghchinoy/tensorflow,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,apark263/tensorflow,hfp/tensorflow-xsmm,Intel-tensorflow/tensorflow,manipopopo/tensorflow,dongjoon-hyun/tensorflow,ghchinoy/tensorflow,jalexvig/tensorflow,aam-at/tensorflow,kobejean/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,asimshankar/tensorflow,brchiu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,chemelnucfin/tensorflow,xzturn/tensorflow,Bismarrck/tensorflow,aselle/tensorflow,manipopopo/tensorflow,apark263/tensorflow,davidzchen/tensorflow,ageron/tensorflow,theflofly/tensorflow,renyi533/tensorflow,cxxgtxy/tensorflow,frreiss/tensorflow-fred,jhseu/tensorflow,ZhangXinNan/tensorflow,AnishShah/tensorflow,frreiss/tensorflow-fred,xzturn/tensorflow,hehongliang/tensorflow,petewarden/tensorflow,seanli9jan/tensorflow,hehongliang/tensorflow,xzturn/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,davidzchen/tensorflow,alsrgv/tensorflow,theflofly/tensorflow,theflofly/tensorflow,ghchinoy/tensorflow,brchiu/tensorflow,ppwwyyxx/tensorflow,hfp/tensorflow-xsmm,xzturn/tensorflow,AnishShah/tensorflow,paolodedios/tensorflow,dancingdan/tensorflow,davidzchen/tensorflow,theflofly/tensorflow,AnishShah/tensorflow,sarvex/tensorflow,renyi533/tensorflow,renyi533/tensorflow,paolodedios/tensorflow,apark263/tensorflow,brchiu/tensorflow,alsrgv/tensorflow,seanli9jan/tensorflow,frreiss/tensorflow-fred,ZhangXinNan/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,seanli9jan/tensorflow,asimshankar/tensorflow,alshedivat/tensorflow,hehongliang/tensorflow,petewarden/tensorflow,aam-at/tensorflow,alsrgv/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow,brchiu/tensorflow,ageron/tensorflow,xzturn/tensorflow,ppwwyyxx/tensorflow,jbedorf/tensorflow,alshedivat/tensorflow,aselle/tensorflow,aselle/tensorflow,kevin-coder/tensorflow-fork,aldian/tensorflow,asimshankar/tensorflow,jbedorf/tensorflow,arborh/tensorflow,Bismarrck/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,ageron/tensorflow,xzturn/tensorflow,girving/tensorflow,dongjoon-hyun/tensorflow,ghchinoy/tensorflow,alsrgv/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,DavidNorman/tensorflow,renyi533/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,chemelnucfin/tensorflow,renyi533/tensorflow,ppwwyyxx/tensorflow,aselle/tensorflow,jalexvig/tensorflow,xodus7/tensorflow,Intel-Corporation/tensorflow,girving/tensorflow,kevin-coder/tensorflow-fork,ageron/tensorflow,jbedorf/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,aam-at/tensorflow,alsrgv/tensorflow,AnishShah/tensorflow,xodus7/tensorflow,jalexvig/tensorflow,hfp/tensorflow-xsmm,alshedivat/tensorflow,aldian/tensorflow,jendap/tensorflow,Intel-tensorflow/tensorflow,yongtang/tensorflow,kevin-coder/tensorflow-fork,chemelnucfin/tensorflow,gautam1858/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,xzturn/tensorflow,Bismarrck/tensorflow,annarev/tensorflow,renyi533/tensorflow,petewarden/tensorflow,xodus7/tensorflow,girving/tensorflow,kobejean/tensorflow,AnishShah/tensorflow,AnishShah/tensorflow,dancingdan/tensorflow,dongjoon-hyun/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,girving/tensorflow,kobejean/tensorflow,alsrgv/tensorflow,petewarden/tensorflow,xzturn/tensorflow,hehongliang/tensorflow,ZhangXinNan/tensorflow,hehongliang/tensorflow,theflofly/tensorflow,jbedorf/tensorflow,ZhangXinNan/tensorflow,annarev/tensorflow,ppwwyyxx/tensorflow,aam-at/tensorflow,paolodedios/tensorflow,jbedorf/tensorflow,karllessard/tensorflow,Intel-tensorflow/tensorflow,theflofly/tensorflow,renyi533/tensorflow,apark263/tensorflow,chemelnucfin/tensorflow,aldian/tensorflow,yongtang/tensorflow,xodus7/tensorflow,aam-at/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,jendap/tensorflow,jendap/tensorflow,dongjoon-hyun/tensorflow,adit-chandra/tensorflow,chemelnucfin/tensorflow,DavidNorman/tensorflow,aselle/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,freedomtan/tensorflow,annarev/tensorflow,davidzchen/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,manipopopo/tensorflow,jbedorf/tensorflow,kobejean/tensorflow,seanli9jan/tensorflow,xodus7/tensorflow,ageron/tensorflow,brchiu/tensorflow,jhseu/tensorflow,yongtang/tensorflow,alshedivat/tensorflow,karllessard/tensorflow,arborh/tensorflow,apark263/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,chemelnucfin/tensorflow,xzturn/tensorflow,AnishShah/tensorflow,jbedorf/tensorflow,apark263/tensorflow,apark263/tensorflow,asimshankar/tensorflow,snnn/tensorflow,theflofly/tensorflow,kobejean/tensorflow,aam-at/tensorflow,apark263/tensorflow,ZhangXinNan/tensorflow,manipopopo/tensorflow,ageron/tensorflow,annarev/tensorflow,Intel-Corporation/tensorflow,dancingdan/tensorflow,kobejean/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,aselle/tensorflow,asimshankar/tensorflow,aselle/tensorflow,Bismarrck/tensorflow,cxxgtxy/tensorflow,ageron/tensorflow,dongjoon-hyun/tensorflow,xodus7/tensorflow,seanli9jan/tensorflow,sarvex/tensorflow,Intel-Corporation/tensorflow,dancingdan/tensorflow,alsrgv/tensorflow,arborh/tensorflow,asimshankar/tensorflow,kobejean/tensorflow,jalexvig/tensorflow,tensorflow/tensorflow,ghchinoy/tensorflow,aselle/tensorflow,aldian/tensorflow,Intel-tensorflow/tensorflow,hfp/tensorflow-xsmm,davidzchen/tensorflow,karllessard/tensorflow,gautam1858/tensorflow,annarev/tensorflow,yongtang/tensorflow,DavidNorman/tensorflow,karllessard/tensorflow,arborh/tensorflow,brchiu/tensorflow,tensorflow/tensorflow,brchiu/tensorflow,jendap/tensorflow,Bismarrck/tensorflow,tensorflow/tensorflow,alshedivat/tensorflow,jalexvig/tensorflow,theflofly/tensorflow,gautam1858/tensorflow,dancingdan/tensorflow,cxxgtxy/tensorflow,adit-chandra/tensorflow,girving/tensorflow,tensorflow/tensorflow,snnn/tensorflow,jhseu/tensorflow,cxxgtxy/tensorflow,freedomtan/tensorflow,AnishShah/tensorflow,jalexvig/tensorflow,paolodedios/tensorflow,jendap/tensorflow,xzturn/tensorflow,DavidNorman/tensorflow,sarvex/tensorflow,yongtang/tensorflow,jbedorf/tensorflow,asimshankar/tensorflow,xodus7/tensorflow,annarev/tensorflow,ageron/tensorflow,snnn/tensorflow,karllessard/tensorflow,gautam1858/tensorflow,jbedorf/tensorflow,seanli9jan/tensorflow,gunan/tensorflow,petewarden/tensorflow,apark263/tensorflow,aldian/tensorflow,freedomtan/tensorflow,alshedivat/tensorflow,jhseu/tensorflow,petewarden/tensorflow,theflofly/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,manipopopo/tensorflow,ppwwyyxx/tensorflow,chemelnucfin/tensorflow,jendap/tensorflow,alshedivat/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,frreiss/tensorflow-fred,hehongliang/tensorflow,dongjoon-hyun/tensorflow,yongtang/tensorflow,freedomtan/tensorflow,davidzchen/tensorflow,freedomtan/tensorflow,ppwwyyxx/tensorflow,girving/tensorflow,ZhangXinNan/tensorflow,tensorflow/tensorflow,aldian/tensorflow,gautam1858/tensorflow,chemelnucfin/tensorflow,paolodedios/tensorflow,theflofly/tensorflow,dancingdan/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,tensorflow/tensorflow