Fixed the KerasOnTPU support for non-sgd optimizer with using_single_core=True.
Fixed the KerasOnTPU support for non-sgd optimizer with using_single_core=True.

PiperOrigin-RevId: 211984222

kevin-coder/tensorflow-fork,annarev/tensorflow,AnishShah/tensorflow,xzturn/tensorflow,freedomtan/tensorflow,freedomtan/tensorflow,kevin-coder/tensorflow-fork,yongtang/tensorflow,seanli9jan/tensorflow,aldian/tensorflow,asimshankar/tensorflow,ghchinoy/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,jbedorf/tensorflow,alshedivat/tensorflow,brchiu/tensorflow,petewarden/tensorflow,jbedorf/tensorflow,xodus7/tensorflow,Intel-tensorflow/tensorflow,girving/tensorflow,girving/tensorflow,frreiss/tensorflow-fred,AnishShah/tensorflow,paolodedios/tensorflow,davidzchen/tensorflow,jendap/tensorflow,Intel-tensorflow/tensorflow,yongtang/tensorflow,annarev/tensorflow,jbedorf/tensorflow,dongjoon-hyun/tensorflow,karllessard/tensorflow,Intel-Corporation/tensorflow,apark263/tensorflow,alshedivat/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-experimental_link_static_libraries_once,frreiss/tensorflow-fred,dancingdan/tensorflow,davidzchen/tensorflow,xzturn/tensorflow,annarev/tensorflow,Intel-tensorflow/tensorflow,jhseu/tensorflow,paolodedios/tensorflow,jbedorf/tensorflow,alshedivat/tensorflow,ppwwyyxx/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,karllessard/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow-pywrap_saved_model,DavidNorman/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,theflofly/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow,alsrgv/tensorflow,dongjoon-hyun/tensorflow,adit-chandra/tensorflow,tensorflow/tensorflow,ppwwyyxx/tensorflow,snnn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,hehongliang/tensorflow,aldian/tensorflow,paolodedios/tensorflow,girving/tensorflow,adit-chandra/tensorflow,xodus7/tensorflow,apark263/tensorflow,renyi533/tensorflow,apark263/tensorflow,girving/tensorflow,ageron/tensorflow,kevin-coder/tensorflow-fork,jhseu/tensorflow,hehongliang/tensorflow,tensorflow/tensorflow-pywrap_saved_model,chemelnucfin/tensorflow,aam-at/tensorflow,DavidNorman/tensorflow,alshedivat/tensorflow,annarev/tensorflow,dancingdan/tensorflow,alshedivat/tensorflow,dancingdan/tensorflow,alshedivat/tensorflow,karllessard/tensorflow,DavidNorman/tensorflow,theflofly/tensorflow,aldian/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,cxxgtxy/tensorflow,seanli9jan/tensorflow,seanli9jan/tensorflow,kobejean/tensorflow,girving/tensorflow,dancingdan/tensorflow,freedomtan/tensorflow,gunan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,kevin-coder/tensorflow-fork,jbedorf/tensorflow,renyi533/tensorflow,gautam1858/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,brchiu/tensorflow,dancingdan/tensorflow,Bismarrck/tensorflow,aam-at/tensorflow,ghchinoy/tensorflow,kevin-coder/tensorflow-fork,kevin-coder/tensorflow-fork,AnishShah/tensorflow,arborh/tensorflow,paolodedios/tensorflow,kobejean/tensorflow,yongtang/tensorflow,paolodedios/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,paolodedios/tensorflow,snnn/tensorflow,asimshankar/tensorflow,asimshankar/tensorflow,ghchinoy/tensorflow,aam-at/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,annarev/tensorflow,davidzchen/tensorflow,jhseu/tensorflow,Intel-Corporation/tensorflow,ghchinoy/tensorflow,gunan/tensorflow,brchiu/tensorflow,Bismarrck/tensorflow,hehongliang/tensorflow,cxxgtxy/tensorflow,Bismarrck/tensorflow,hfp/tensorflow-xsmm,seanli9jan/tensorflow,davidzchen/tensorflow,gunan/tensorflow,karllessard/tensorflow,aam-at/tensorflow,AnishShah/tensorflow,cxxgtxy/tensorflow,ppwwyyxx/tensorflow,kevin-coder/tensorflow-fork,girving/tensorflow,davidzchen/tensorflow,adit-chandra/tensorflow,annarev/tensorflow,girving/tensorflow,adit-chandra/tensorflow,paolodedios/tensorflow,xzturn/tensorflow,dancingdan/tensorflow,ppwwyyxx/tensorflow,renyi533/tensorflow,kevin-coder/tensorflow-fork,Intel-Corporation/tensorflow,renyi533/tensorflow,brchiu/tensorflow,petewarden/tensorflow,cxxgtxy/tensorflow,frreiss/tensorflow-fred,ppwwyyxx/tensorflow,jbedorf/tensorflow,renyi533/tensorflow,Bismarrck/tensorflow,xodus7/tensorflow,Intel-Corporation/tensorflow,adit-chandra/tensorflow,AnishShah/tensorflow,xzturn/tensorflow,AnishShah/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,xodus7/tensorflow,jhseu/tensorflow,xzturn/tensorflow,aldian/tensorflow,gunan/tensorflow,ppwwyyxx/tensorflow,seanli9jan/tensorflow,adit-chandra/tensorflow,apark263/tensorflow,frreiss/tensorflow-fred,brchiu/tensorflow,brchiu/tensorflow,yongtang/tensorflow,dongjoon-hyun/tensorflow,chemelnucfin/tensorflow,adit-chandra/tensorflow,adit-chandra/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_saved_model,davidzchen/tensorflow,alshedivat/tensorflow,cxxgtxy/tensorflow,yongtang/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow-pywrap_saved_model,hfp/tensorflow-xsmm,gautam1858/tensorflow,jendap/tensorflow,theflofly/tensorflow,theflofly/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,theflofly/tensorflow,hfp/tensorflow-xsmm,cxxgtxy/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,gunan/tensorflow,freedomtan/tensorflow,karllessard/tensorflow,aldian/tensorflow,aam-at/tensorflow,seanli9jan/tensorflow,theflofly/tensorflow,aam-at/tensorflow,paolodedios/tensorflow,Bismarrck/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow,xodus7/tensorflow,xzturn/tensorflow,xodus7/tensorflow,hehongliang/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,kevin-coder/tensorflow-fork,asimshankar/tensorflow,snnn/tensorflow,arborh/tensorflow,kobejean/tensorflow,gunan/tensorflow,hfp/tensorflow-xsmm,cxxgtxy/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow,seanli9jan/tensorflow,freedomtan/tensorflow,cxxgtxy/tensorflow,dongjoon-hyun/tensorflow,dancingdan/tensorflow,theflofly/tensorflow,paolodedios/tensorflow,aam-at/tensorflow,jbedorf/tensorflow,yongtang/tensorflow,xzturn/tensorflow,kobejean/tensorflow,frreiss/tensorflow-fred,alshedivat/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,renyi533/tensorflow,theflofly/tensorflow,sarvex/tensorflow,petewarden/tensorflow,ageron/tensorflow,karllessard/tensorflow,AnishShah/tensorflow,aldian/tensorflow,theflofly/tensorflow,alsrgv/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kevin-coder/tensorflow-fork,annarev/tensorflow,DavidNorman/tensorflow,arborh/tensorflow,theflofly/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,xodus7/tensorflow,apark263/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,AnishShah/tensorflow,freedomtan/tensorflow,renyi533/tensorflow,Intel-tensorflow/tensorflow,DavidNorman/tensorflow,dancingdan/tensorflow,jbedorf/tensorflow,Intel-Corporation/tensorflow,gautam1858/tensorflow,jendap/tensorflow,hfp/tensorflow-xsmm,alsrgv/tensorflow,renyi533/tensorflow,theflofly/tensorflow,snnn/tensorflow,kevin-coder/tensorflow-fork,snnn/tensorflow,ageron/tensorflow,ageron/tensorflow,xzturn/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,aam-at/tensorflow,arborh/tensorflow,ppwwyyxx/tensorflow,asimshankar/tensorflow,Bismarrck/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow,gautam1858/tensorflow,DavidNorman/tensorflow,aam-at/tensorflow,adit-chandra/tensorflow,alsrgv/tensorflow,Intel-tensorflow/tensorflow,jbedorf/tensorflow,adit-chandra/tensorflow,arborh/tensorflow,snnn/tensorflow,ghchinoy/tensorflow,DavidNorman/tensorflow,alshedivat/tensorflow,ghchinoy/tensorflow,Intel-tensorflow/tensorflow,gunan/tensorflow,chemelnucfin/tensorflow,kobejean/tensorflow,arborh/tensorflow,theflofly/tensorflow,alshedivat/tensorflow,dongjoon-hyun/tensorflow,arborh/tensorflow,hfp/tensorflow-xsmm,gunan/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,annarev/tensorflow,tensorflow/tensorflow,karllessard/tensorflow,kobejean/tensorflow,karllessard/tensorflow,jendap/tensorflow,tensorflow/tensorflow,ppwwyyxx/tensorflow,ageron/tensorflow,alsrgv/tensorflow,jhseu/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,kobejean/tensorflow,freedomtan/tensorflow,sarvex/tensorflow,arborh/tensorflow,brchiu/tensorflow,gautam1858/tensorflow,sarvex/tensorflow,paolodedios/tensorflow,hfp/tensorflow-xsmm,gautam1858/tensorflow,petewarden/tensorflow,hfp/tensorflow-xsmm,snnn/tensorflow,ppwwyyxx/tensorflow,arborh/tensorflow,hfp/tensorflow-xsmm,hehongliang/tensorflow,seanli9jan/tensorflow,dongjoon-hyun/tensorflow,paolodedios/tensorflow,apark263/tensorflow,kobejean/tensorflow,jendap/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_saved_model,petewarden/tensorflow,ppwwyyxx/tensorflow,arborh/tensorflow,chemelnucfin/tensorflow,Intel-Corporation/tensorflow,ghchinoy/tensorflow,Intel-tensorflow/tensorflow,chemelnucfin/tensorflow,gautam1858/tensorflow,hfp/tensorflow-xsmm,sarvex/tensorflow,brchiu/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,AnishShah/tensorflow,AnishShah/tensorflow,chemelnucfin/tensorflow,snnn/tensorflow,alsrgv/tensorflow,jendap/tensorflow,frreiss/tensorflow-fred,sarvex/tensorflow,davidzchen/tensorflow,Bismarrck/tensorflow,gunan/tensorflow,dancingdan/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,chemelnucfin/tensorflow,alsrgv/tensorflow,ppwwyyxx/tensorflow,davidzchen/tensorflow,apark263/tensorflow,brchiu/tensorflow,davidzchen/tensorflow,kobejean/tensorflow,xodus7/tensorflow,tensorflow/tensorflow,alsrgv/tensorflow,Bismarrck/tensorflow,hehongliang/tensorflow,sarvex/tensorflow,jbedorf/tensorflow,jhseu/tensorflow,girving/tensorflow,petewarden/tensorflow,yongtang/tensorflow,davidzchen/tensorflow,ageron/tensorflow,yongtang/tensorflow,petewarden/tensorflow,apark263/tensorflow,kobejean/tensorflow,jhseu/tensorflow,petewarden/tensorflow,renyi533/tensorflow,annarev/tensorflow,tensorflow/tensorflow-pywrap_saved_model,ppwwyyxx/tensorflow,alshedivat/tensorflow,seanli9jan/tensorflow,chemelnucfin/tensorflow,asimshankar/tensorflow,asimshankar/tensorflow,xodus7/tensorflow,aldian/tensorflow,chemelnucfin/tensorflow,ghchinoy/tensorflow,sarvex/tensorflow,Bismarrck/tensorflow,freedomtan/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow-pywrap_saved_model,brchiu/tensorflow,apark263/tensorflow,jbedorf/tensorflow,chemelnucfin/tensorflow,kobejean/tensorflow,ghchinoy/tensorflow,frreiss/tensorflow-fred,DavidNorman/tensorflow,dancingdan/tensorflow,ageron/tensorflow,petewarden/tensorflow,DavidNorman/tensorflow,asimshankar/tensorflow,frreiss/tensorflow-fred,adit-chandra/tensorflow,jbedorf/tensorflow,renyi533/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,sarvex/tensorflow,jendap/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-experimental_link_static_libraries_once,alsrgv/tensorflow,ageron/tensorflow,jendap/tensorflow,annarev/tensorflow,snnn/tensorflow,aam-at/tensorflow,jhseu/tensorflow,asimshankar/tensorflow,xodus7/tensorflow,jhseu/tensorflow,girving/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,tensorflow/tensorflow-pywrap_saved_model,girving/tensorflow,Intel-Corporation/tensorflow,dongjoon-hyun/tensorflow,ageron/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,gunan/tensorflow,brchiu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,renyi533/tensorflow,AnishShah/tensorflow,apark263/tensorflow,apark263/tensorflow,xzturn/tensorflow,gunan/tensorflow,xzturn/tensorflow,girving/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jendap/tensorflow,dongjoon-hyun/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,alsrgv/tensorflow,jhseu/tensorflow,alsrgv/tensorflow,seanli9jan/tensorflow,DavidNorman/tensorflow,karllessard/tensorflow,yongtang/tensorflow,aldian/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,Bismarrck/tensorflow,asimshankar/tensorflow,jendap/tensorflow,snnn/tensorflow,renyi533/tensorflow,ageron/tensorflow,jhseu/tensorflow,hfp/tensorflow-xsmm,hehongliang/tensorflow,annarev/tensorflow,yongtang/tensorflow,frreiss/tensorflow-fred,adit-chandra/tensorflow,arborh/tensorflow,xzturn/tensorflow,jendap/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-pywrap_saved_model,seanli9jan/tensorflow,ageron/tensorflow,ageron/tensorflow,xodus7/tensorflow,snnn/tensorflow,DavidNorman/tensorflow,yongtang/tensorflow,freedomtan/tensorflow