Fix NAdam optimizer, 1) assert dependency between iteration update and variable update, 2) include momentum caching as state variable.
Fix NAdam optimizer, 1) assert dependency between iteration update and variable
update, 2) include momentum caching as state variable.

PiperOrigin-RevId: 226429048

xzturn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,adit-chandra/tensorflow,theflofly/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kevin-coder/tensorflow-fork,hfp/tensorflow-xsmm,Intel-Corporation/tensorflow,jendap/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,kevin-coder/tensorflow-fork,jendap/tensorflow,jhseu/tensorflow,freedomtan/tensorflow,jhseu/tensorflow,freedomtan/tensorflow,karllessard/tensorflow,cxxgtxy/tensorflow,frreiss/tensorflow-fred,cxxgtxy/tensorflow,theflofly/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,alsrgv/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kevin-coder/tensorflow-fork,karllessard/tensorflow,apark263/tensorflow,renyi533/tensorflow,jbedorf/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,ghchinoy/tensorflow,annarev/tensorflow,freedomtan/tensorflow,ppwwyyxx/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,Intel-tensorflow/tensorflow,jbedorf/tensorflow,paolodedios/tensorflow,ageron/tensorflow,jendap/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,gunan/tensorflow,adit-chandra/tensorflow,aam-at/tensorflow,theflofly/tensorflow,paolodedios/tensorflow,ppwwyyxx/tensorflow,annarev/tensorflow,freedomtan/tensorflow,annarev/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,hfp/tensorflow-xsmm,cxxgtxy/tensorflow,gunan/tensorflow,aam-at/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,adit-chandra/tensorflow,tensorflow/tensorflow,jhseu/tensorflow,kevin-coder/tensorflow-fork,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,DavidNorman/tensorflow,alsrgv/tensorflow,Intel-Corporation/tensorflow,jendap/tensorflow,xzturn/tensorflow,yongtang/tensorflow,xzturn/tensorflow,ghchinoy/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_tf_optimizer,theflofly/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow,ageron/tensorflow,arborh/tensorflow,chemelnucfin/tensorflow,jbedorf/tensorflow,davidzchen/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_saved_model,petewarden/tensorflow,DavidNorman/tensorflow,yongtang/tensorflow,arborh/tensorflow,kevin-coder/tensorflow-fork,hfp/tensorflow-xsmm,ppwwyyxx/tensorflow,davidzchen/tensorflow,jendap/tensorflow,jendap/tensorflow,arborh/tensorflow,karllessard/tensorflow,gautam1858/tensorflow,theflofly/tensorflow,sarvex/tensorflow,hfp/tensorflow-xsmm,arborh/tensorflow,sarvex/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,adit-chandra/tensorflow,chemelnucfin/tensorflow,aam-at/tensorflow,jhseu/tensorflow,davidzchen/tensorflow,apark263/tensorflow,renyi533/tensorflow,renyi533/tensorflow,theflofly/tensorflow,annarev/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,karllessard/tensorflow,gunan/tensorflow,ppwwyyxx/tensorflow,paolodedios/tensorflow,Intel-tensorflow/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_saved_model,theflofly/tensorflow,jendap/tensorflow,davidzchen/tensorflow,frreiss/tensorflow-fred,apark263/tensorflow,ageron/tensorflow,freedomtan/tensorflow,cxxgtxy/tensorflow,paolodedios/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,petewarden/tensorflow,chemelnucfin/tensorflow,xzturn/tensorflow,alsrgv/tensorflow,kevin-coder/tensorflow-fork,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,sarvex/tensorflow,gunan/tensorflow,ppwwyyxx/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-pywrap_saved_model,cxxgtxy/tensorflow,ghchinoy/tensorflow,hfp/tensorflow-xsmm,jhseu/tensorflow,karllessard/tensorflow,petewarden/tensorflow,aldian/tensorflow,alsrgv/tensorflow,DavidNorman/tensorflow,aam-at/tensorflow,alsrgv/tensorflow,adit-chandra/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,DavidNorman/tensorflow,ppwwyyxx/tensorflow,hfp/tensorflow-xsmm,annarev/tensorflow,jbedorf/tensorflow,ageron/tensorflow,tensorflow/tensorflow,jhseu/tensorflow,freedomtan/tensorflow,renyi533/tensorflow,gunan/tensorflow,jbedorf/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,karllessard/tensorflow,chemelnucfin/tensorflow,aldian/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_saved_model,petewarden/tensorflow,paolodedios/tensorflow,jbedorf/tensorflow,apark263/tensorflow,annarev/tensorflow,karllessard/tensorflow,paolodedios/tensorflow,theflofly/tensorflow,renyi533/tensorflow,ghchinoy/tensorflow,theflofly/tensorflow,ghchinoy/tensorflow,ghchinoy/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aam-at/tensorflow,ageron/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-experimental_link_static_libraries_once,adit-chandra/tensorflow,ppwwyyxx/tensorflow,frreiss/tensorflow-fred,DavidNorman/tensorflow,aam-at/tensorflow,ghchinoy/tensorflow,chemelnucfin/tensorflow,alsrgv/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kevin-coder/tensorflow-fork,freedomtan/tensorflow,apark263/tensorflow,xzturn/tensorflow,ageron/tensorflow,hfp/tensorflow-xsmm,arborh/tensorflow,arborh/tensorflow,gautam1858/tensorflow,jendap/tensorflow,yongtang/tensorflow,arborh/tensorflow,gunan/tensorflow,davidzchen/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,yongtang/tensorflow,jendap/tensorflow,renyi533/tensorflow,gautam1858/tensorflow,ghchinoy/tensorflow,arborh/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,chemelnucfin/tensorflow,freedomtan/tensorflow,adit-chandra/tensorflow,petewarden/tensorflow,ageron/tensorflow,kevin-coder/tensorflow-fork,alsrgv/tensorflow,gautam1858/tensorflow,DavidNorman/tensorflow,xzturn/tensorflow,apark263/tensorflow,ppwwyyxx/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,adit-chandra/tensorflow,jhseu/tensorflow,chemelnucfin/tensorflow,jhseu/tensorflow,Intel-tensorflow/tensorflow,xzturn/tensorflow,theflofly/tensorflow,apark263/tensorflow,yongtang/tensorflow,chemelnucfin/tensorflow,Intel-Corporation/tensorflow,gautam1858/tensorflow,hfp/tensorflow-xsmm,petewarden/tensorflow,sarvex/tensorflow,tensorflow/tensorflow,adit-chandra/tensorflow,ppwwyyxx/tensorflow,DavidNorman/tensorflow,adit-chandra/tensorflow,renyi533/tensorflow,chemelnucfin/tensorflow,xzturn/tensorflow,jhseu/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,tensorflow/tensorflow,ageron/tensorflow,ghchinoy/tensorflow,Intel-tensorflow/tensorflow,Intel-tensorflow/tensorflow,alsrgv/tensorflow,theflofly/tensorflow,annarev/tensorflow,apark263/tensorflow,yongtang/tensorflow,adit-chandra/tensorflow,xzturn/tensorflow,davidzchen/tensorflow,annarev/tensorflow,gunan/tensorflow,jhseu/tensorflow,arborh/tensorflow,ppwwyyxx/tensorflow,davidzchen/tensorflow,karllessard/tensorflow,apark263/tensorflow,ageron/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,paolodedios/tensorflow,sarvex/tensorflow,davidzchen/tensorflow,chemelnucfin/tensorflow,jbedorf/tensorflow,xzturn/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,jbedorf/tensorflow,gautam1858/tensorflow,gunan/tensorflow,jhseu/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,apark263/tensorflow,DavidNorman/tensorflow,renyi533/tensorflow,gunan/tensorflow,ghchinoy/tensorflow,yongtang/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,hfp/tensorflow-xsmm,frreiss/tensorflow-fred,tensorflow/tensorflow,frreiss/tensorflow-fred,ppwwyyxx/tensorflow,aldian/tensorflow,ageron/tensorflow,renyi533/tensorflow,Intel-Corporation/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,hfp/tensorflow-xsmm,kevin-coder/tensorflow-fork,kevin-coder/tensorflow-fork,aldian/tensorflow,jbedorf/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aldian/tensorflow,aldian/tensorflow,ageron/tensorflow,ghchinoy/tensorflow,theflofly/tensorflow,chemelnucfin/tensorflow,annarev/tensorflow,sarvex/tensorflow,gautam1858/tensorflow,renyi533/tensorflow,Intel-Corporation/tensorflow,xzturn/tensorflow,jendap/tensorflow,aldian/tensorflow,freedomtan/tensorflow,renyi533/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,annarev/tensorflow,alsrgv/tensorflow,xzturn/tensorflow,Intel-Corporation/tensorflow,ageron/tensorflow,Intel-tensorflow/tensorflow,kevin-coder/tensorflow-fork,jhseu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,DavidNorman/tensorflow,DavidNorman/tensorflow,apark263/tensorflow,adit-chandra/tensorflow,jbedorf/tensorflow,arborh/tensorflow,ppwwyyxx/tensorflow,yongtang/tensorflow,jendap/tensorflow,sarvex/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow,aam-at/tensorflow,sarvex/tensorflow,paolodedios/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_saved_model,aldian/tensorflow,petewarden/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,arborh/tensorflow,davidzchen/tensorflow,frreiss/tensorflow-fred,aam-at/tensorflow,annarev/tensorflow