Adds an example showing a fault-tolerant custom training loop with MultiWorkerMirroredStrategy.
Adds an example showing a fault-tolerant custom training loop with MultiWorkerMirroredStrategy.

In this module, it is demonstrated how MultiWorkerMirroredStrategy can be used
with custom training loop (CTL) in a fault tolerant way. Consider a simple case
where two workers are training synchronously, when a worker fails (referred
to as the "failed worker"), the other worker (referred to as the
"handled worker") would experience `UnavailableError` which gets handled as
illustrated in this exampl...

PiperOrigin-RevId: 290090890
Change-Id: I0fbc333446cc5f7e1021dd7c1d9a812beecf6c1c

frreiss/tensorflow-fred,renyi533/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,freedomtan/tensorflow,freedomtan/tensorflow,renyi533/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,xzturn/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,aam-at/tensorflow,annarev/tensorflow,sarvex/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,Intel-tensorflow/tensorflow,freedomtan/tensorflow,annarev/tensorflow,freedomtan/tensorflow,paolodedios/tensorflow,renyi533/tensorflow,Intel-tensorflow/tensorflow,freedomtan/tensorflow,jhseu/tensorflow,Intel-Corporation/tensorflow,Intel-Corporation/tensorflow,freedomtan/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,annarev/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jhseu/tensorflow,paolodedios/tensorflow,aam-at/tensorflow,petewarden/tensorflow,annarev/tensorflow,gunan/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,jhseu/tensorflow,gunan/tensorflow,paolodedios/tensorflow,renyi533/tensorflow,freedomtan/tensorflow,xzturn/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_tf_optimizer,frreiss/tensorflow-fred,tensorflow/tensorflow,karllessard/tensorflow,xzturn/tensorflow,renyi533/tensorflow,paolodedios/tensorflow,gunan/tensorflow,renyi533/tensorflow,davidzchen/tensorflow,aldian/tensorflow,aldian/tensorflow,sarvex/tensorflow,xzturn/tensorflow,jhseu/tensorflow,freedomtan/tensorflow,xzturn/tensorflow,aldian/tensorflow,yongtang/tensorflow,xzturn/tensorflow,karllessard/tensorflow,petewarden/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,jhseu/tensorflow,aam-at/tensorflow,jhseu/tensorflow,xzturn/tensorflow,jhseu/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,davidzchen/tensorflow,tensorflow/tensorflow,yongtang/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,cxxgtxy/tensorflow,tensorflow/tensorflow,annarev/tensorflow,davidzchen/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,davidzchen/tensorflow,cxxgtxy/tensorflow,yongtang/tensorflow,yongtang/tensorflow,yongtang/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_saved_model,karllessard/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-Corporation/tensorflow,petewarden/tensorflow,frreiss/tensorflow-fred,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-experimental_link_static_libraries_once,karllessard/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,petewarden/tensorflow,renyi533/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,cxxgtxy/tensorflow,gunan/tensorflow,davidzchen/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_saved_model,aam-at/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,tensorflow/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,renyi533/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow,yongtang/tensorflow,gunan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-pywrap_tf_optimizer,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,Intel-tensorflow/tensorflow,annarev/tensorflow,tensorflow/tensorflow,aam-at/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,aldian/tensorflow,gautam1858/tensorflow,yongtang/tensorflow,Intel-tensorflow/tensorflow,paolodedios/tensorflow,davidzchen/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,paolodedios/tensorflow,aldian/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow,yongtang/tensorflow,cxxgtxy/tensorflow,davidzchen/tensorflow,annarev/tensorflow,freedomtan/tensorflow,freedomtan/tensorflow,aldian/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,gautam1858/tensorflow,sarvex/tensorflow,Intel-Corporation/tensorflow,jhseu/tensorflow,karllessard/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,renyi533/tensorflow,tensorflow/tensorflow-pywrap_saved_model,cxxgtxy/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gautam1858/tensorflow,annarev/tensorflow,petewarden/tensorflow,sarvex/tensorflow,petewarden/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,frreiss/tensorflow-fred,aam-at/tensorflow,tensorflow/tensorflow,xzturn/tensorflow,Intel-Corporation/tensorflow,renyi533/tensorflow,petewarden/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,annarev/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,jhseu/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_tf_optimizer,aldian/tensorflow,sarvex/tensorflow,yongtang/tensorflow,karllessard/tensorflow,annarev/tensorflow,gautam1858/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow,freedomtan/tensorflow,sarvex/tensorflow,paolodedios/tensorflow,jhseu/tensorflow,annarev/tensorflow,xzturn/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,karllessard/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,davidzchen/tensorflow,karllessard/tensorflow,aldian/tensorflow,xzturn/tensorflow,davidzchen/tensorflow,freedomtan/tensorflow,Intel-tensorflow/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,karllessard/tensorflow,cxxgtxy/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once