[Intel MKL] Using default CPU allocator for small allocations in MklCPUAllocator
[Intel MKL] Using default CPU allocator for small allocations in MklCPUAllocator

This PR adds support to use default CPU allocator for handling small-size
allocations. We found that BFC allocator does not do well on small allocations,
but is good for large allocations.

asimshankar/tensorflow,Intel-tensorflow/tensorflow,xodus7/tensorflow,hehongliang/tensorflow,gautam1858/tensorflow,dancingdan/tensorflow,aldian/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,apark263/tensorflow,seanli9jan/tensorflow,ghchinoy/tensorflow,ghchinoy/tensorflow,kobejean/tensorflow,annarev/tensorflow,gunan/tensorflow,paolodedios/tensorflow,davidzchen/tensorflow,frreiss/tensorflow-fred,DavidNorman/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,xzturn/tensorflow,sarvex/tensorflow,apark263/tensorflow,theflofly/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow,alsrgv/tensorflow,renyi533/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jendap/tensorflow,hfp/tensorflow-xsmm,hfp/tensorflow-xsmm,alshedivat/tensorflow,arborh/tensorflow,xzturn/tensorflow,alshedivat/tensorflow,aam-at/tensorflow,annarev/tensorflow,snnn/tensorflow,asimshankar/tensorflow,frreiss/tensorflow-fred,kevin-coder/tensorflow-fork,freedomtan/tensorflow,alshedivat/tensorflow,xzturn/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,xodus7/tensorflow,asimshankar/tensorflow,DavidNorman/tensorflow,freedomtan/tensorflow,davidzchen/tensorflow,girving/tensorflow,jhseu/tensorflow,alsrgv/tensorflow,annarev/tensorflow,snnn/tensorflow,yongtang/tensorflow,Intel-Corporation/tensorflow,aldian/tensorflow,asimshankar/tensorflow,yongtang/tensorflow,xodus7/tensorflow,gunan/tensorflow,AnishShah/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,alsrgv/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,snnn/tensorflow,ppwwyyxx/tensorflow,annarev/tensorflow,kevin-coder/tensorflow-fork,DavidNorman/tensorflow,brchiu/tensorflow,paolodedios/tensorflow,seanli9jan/tensorflow,gunan/tensorflow,gunan/tensorflow,hfp/tensorflow-xsmm,girving/tensorflow,seanli9jan/tensorflow,cxxgtxy/tensorflow,ghchinoy/tensorflow,jendap/tensorflow,tensorflow/tensorflow,brchiu/tensorflow,renyi533/tensorflow,karllessard/tensorflow,gunan/tensorflow,theflofly/tensorflow,ppwwyyxx/tensorflow,adit-chandra/tensorflow,ppwwyyxx/tensorflow,brchiu/tensorflow,yongtang/tensorflow,Intel-Corporation/tensorflow,gautam1858/tensorflow,Bismarrck/tensorflow,petewarden/tensorflow,ppwwyyxx/tensorflow,xzturn/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,dancingdan/tensorflow,frreiss/tensorflow-fred,arborh/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jbedorf/tensorflow,renyi533/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,jendap/tensorflow,apark263/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,renyi533/tensorflow,arborh/tensorflow,aldian/tensorflow,hfp/tensorflow-xsmm,gautam1858/tensorflow,davidzchen/tensorflow,jbedorf/tensorflow,ageron/tensorflow,Intel-tensorflow/tensorflow,jbedorf/tensorflow,xodus7/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aldian/tensorflow,arborh/tensorflow,DavidNorman/tensorflow,brchiu/tensorflow,sarvex/tensorflow,chemelnucfin/tensorflow,alsrgv/tensorflow,theflofly/tensorflow,tensorflow/tensorflow,chemelnucfin/tensorflow,theflofly/tensorflow,kobejean/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,jhseu/tensorflow,karllessard/tensorflow,alshedivat/tensorflow,karllessard/tensorflow,Intel-Corporation/tensorflow,AnishShah/tensorflow,seanli9jan/tensorflow,kevin-coder/tensorflow-fork,jendap/tensorflow,gunan/tensorflow,dancingdan/tensorflow,seanli9jan/tensorflow,adit-chandra/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,dongjoon-hyun/tensorflow,renyi533/tensorflow,aldian/tensorflow,Intel-tensorflow/tensorflow,dancingdan/tensorflow,ppwwyyxx/tensorflow,alsrgv/tensorflow,asimshankar/tensorflow,Bismarrck/tensorflow,AnishShah/tensorflow,ghchinoy/tensorflow,petewarden/tensorflow,girving/tensorflow,Intel-tensorflow/tensorflow,jendap/tensorflow,cxxgtxy/tensorflow,Bismarrck/tensorflow,petewarden/tensorflow,paolodedios/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aldian/tensorflow,ppwwyyxx/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,ghchinoy/tensorflow,xzturn/tensorflow,paolodedios/tensorflow,ghchinoy/tensorflow,Intel-Corporation/tensorflow,DavidNorman/tensorflow,xzturn/tensorflow,ageron/tensorflow,paolodedios/tensorflow,alsrgv/tensorflow,kobejean/tensorflow,Intel-tensorflow/tensorflow,ghchinoy/tensorflow,chemelnucfin/tensorflow,alshedivat/tensorflow,cxxgtxy/tensorflow,dongjoon-hyun/tensorflow,kevin-coder/tensorflow-fork,ppwwyyxx/tensorflow,theflofly/tensorflow,alsrgv/tensorflow,karllessard/tensorflow,hehongliang/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,hehongliang/tensorflow,adit-chandra/tensorflow,brchiu/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jhseu/tensorflow,davidzchen/tensorflow,alsrgv/tensorflow,adit-chandra/tensorflow,aam-at/tensorflow,aam-at/tensorflow,ppwwyyxx/tensorflow,kevin-coder/tensorflow-fork,theflofly/tensorflow,freedomtan/tensorflow,Intel-Corporation/tensorflow,adit-chandra/tensorflow,cxxgtxy/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,seanli9jan/tensorflow,DavidNorman/tensorflow,sarvex/tensorflow,sarvex/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow,xzturn/tensorflow,jhseu/tensorflow,xzturn/tensorflow,paolodedios/tensorflow,AnishShah/tensorflow,petewarden/tensorflow,dancingdan/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-pywrap_saved_model,theflofly/tensorflow,snnn/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,theflofly/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,brchiu/tensorflow,apark263/tensorflow,chemelnucfin/tensorflow,xodus7/tensorflow,brchiu/tensorflow,jendap/tensorflow,kevin-coder/tensorflow-fork,alshedivat/tensorflow,renyi533/tensorflow,xzturn/tensorflow,yongtang/tensorflow,sarvex/tensorflow,AnishShah/tensorflow,frreiss/tensorflow-fred,gautam1858/tensorflow,alshedivat/tensorflow,ppwwyyxx/tensorflow,annarev/tensorflow,dongjoon-hyun/tensorflow,aam-at/tensorflow,girving/tensorflow,jendap/tensorflow,renyi533/tensorflow,ppwwyyxx/tensorflow,hfp/tensorflow-xsmm,xodus7/tensorflow,alsrgv/tensorflow,snnn/tensorflow,davidzchen/tensorflow,xzturn/tensorflow,asimshankar/tensorflow,ageron/tensorflow,dongjoon-hyun/tensorflow,aldian/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,girving/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,adit-chandra/tensorflow,karllessard/tensorflow,apark263/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kobejean/tensorflow,arborh/tensorflow,ghchinoy/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow-pywrap_saved_model,karllessard/tensorflow,dancingdan/tensorflow,gautam1858/tensorflow,hfp/tensorflow-xsmm,jendap/tensorflow,kevin-coder/tensorflow-fork,seanli9jan/tensorflow,jbedorf/tensorflow,ageron/tensorflow,jbedorf/tensorflow,ageron/tensorflow,Bismarrck/tensorflow,brchiu/tensorflow,aldian/tensorflow,jendap/tensorflow,Bismarrck/tensorflow,chemelnucfin/tensorflow,kobejean/tensorflow,alshedivat/tensorflow,AnishShah/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow,xodus7/tensorflow,alshedivat/tensorflow,snnn/tensorflow,snnn/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jbedorf/tensorflow,cxxgtxy/tensorflow,apark263/tensorflow,Bismarrck/tensorflow,sarvex/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,adit-chandra/tensorflow,Bismarrck/tensorflow,ageron/tensorflow,gautam1858/tensorflow,dongjoon-hyun/tensorflow,frreiss/tensorflow-fred,ppwwyyxx/tensorflow,Bismarrck/tensorflow,kobejean/tensorflow,jbedorf/tensorflow,dancingdan/tensorflow,chemelnucfin/tensorflow,AnishShah/tensorflow,aam-at/tensorflow,Bismarrck/tensorflow,ppwwyyxx/tensorflow,asimshankar/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,adit-chandra/tensorflow,girving/tensorflow,hehongliang/tensorflow,hfp/tensorflow-xsmm,karllessard/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,kevin-coder/tensorflow-fork,yongtang/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow,ageron/tensorflow,renyi533/tensorflow,tensorflow/tensorflow,sarvex/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,jbedorf/tensorflow,alshedivat/tensorflow,kobejean/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kevin-coder/tensorflow-fork,jhseu/tensorflow,Intel-Corporation/tensorflow,aam-at/tensorflow,xodus7/tensorflow,Intel-tensorflow/tensorflow,jbedorf/tensorflow,apark263/tensorflow,renyi533/tensorflow,brchiu/tensorflow,arborh/tensorflow,jbedorf/tensorflow,snnn/tensorflow,petewarden/tensorflow,dongjoon-hyun/tensorflow,jhseu/tensorflow,ageron/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,cxxgtxy/tensorflow,annarev/tensorflow,adit-chandra/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,xodus7/tensorflow,chemelnucfin/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow,annarev/tensorflow,xodus7/tensorflow,hehongliang/tensorflow,apark263/tensorflow,tensorflow/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,girving/tensorflow,Intel-Corporation/tensorflow,arborh/tensorflow,freedomtan/tensorflow,alsrgv/tensorflow,adit-chandra/tensorflow,snnn/tensorflow,gunan/tensorflow,girving/tensorflow,annarev/tensorflow,hfp/tensorflow-xsmm,girving/tensorflow,AnishShah/tensorflow,dongjoon-hyun/tensorflow,arborh/tensorflow,petewarden/tensorflow,kevin-coder/tensorflow-fork,DavidNorman/tensorflow,Intel-tensorflow/tensorflow,hfp/tensorflow-xsmm,ghchinoy/tensorflow,davidzchen/tensorflow,brchiu/tensorflow,girving/tensorflow,arborh/tensorflow,jhseu/tensorflow,dancingdan/tensorflow,adit-chandra/tensorflow,Intel-Corporation/tensorflow,alshedivat/tensorflow,petewarden/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,apark263/tensorflow,jhseu/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,snnn/tensorflow,davidzchen/tensorflow,paolodedios/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,xzturn/tensorflow,ageron/tensorflow,annarev/tensorflow,annarev/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,annarev/tensorflow,theflofly/tensorflow,freedomtan/tensorflow,gunan/tensorflow,jbedorf/tensorflow,renyi533/tensorflow,dancingdan/tensorflow,alsrgv/tensorflow,ghchinoy/tensorflow,frreiss/tensorflow-fred,hehongliang/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,sarvex/tensorflow,davidzchen/tensorflow,xodus7/tensorflow,freedomtan/tensorflow,jhseu/tensorflow,kobejean/tensorflow,asimshankar/tensorflow,adit-chandra/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,paolodedios/tensorflow,hfp/tensorflow-xsmm,theflofly/tensorflow,cxxgtxy/tensorflow,snnn/tensorflow,arborh/tensorflow,dongjoon-hyun/tensorflow,davidzchen/tensorflow,ageron/tensorflow,arborh/tensorflow,yongtang/tensorflow,yongtang/tensorflow,AnishShah/tensorflow,theflofly/tensorflow,chemelnucfin/tensorflow,brchiu/tensorflow,girving/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_saved_model,asimshankar/tensorflow,dongjoon-hyun/tensorflow,ghchinoy/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,hehongliang/tensorflow,petewarden/tensorflow,alsrgv/tensorflow,kevin-coder/tensorflow-fork,karllessard/tensorflow,karllessard/tensorflow,jendap/tensorflow,DavidNorman/tensorflow,seanli9jan/tensorflow,DavidNorman/tensorflow,chemelnucfin/tensorflow,apark263/tensorflow,karllessard/tensorflow,apark263/tensorflow,gautam1858/tensorflow,theflofly/tensorflow,gunan/tensorflow,ageron/tensorflow,jhseu/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,AnishShah/tensorflow,chemelnucfin/tensorflow,renyi533/tensorflow,davidzchen/tensorflow,paolodedios/tensorflow,arborh/tensorflow,Intel-tensorflow/tensorflow,gunan/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,Intel-tensorflow/tensorflow,renyi533/tensorflow,yongtang/tensorflow,aam-at/tensorflow,AnishShah/tensorflow,jendap/tensorflow,ageron/tensorflow