Add a unit test demonstrating collective ops with different groups of devices.
Add a unit test demonstrating collective ops with different groups of devices.

Collectives configured this way can be used to implement all-reduce for batch
norm with a subset of all available devices.

PiperOrigin-RevId: 316927203
Change-Id: Ic288d01134776efbe0e49a83fd8030f721890725

yongtang/tensorflow,cxxgtxy/tensorflow,karllessard/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-experimental_link_static_libraries_once,karllessard/tensorflow,paolodedios/tensorflow,sarvex/tensorflow,freedomtan/tensorflow,Intel-Corporation/tensorflow,freedomtan/tensorflow,sarvex/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,aam-at/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aam-at/tensorflow,davidzchen/tensorflow,aldian/tensorflow,yongtang/tensorflow,sarvex/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,karllessard/tensorflow,frreiss/tensorflow-fred,frreiss/tensorflow-fred,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,freedomtan/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,sarvex/tensorflow,cxxgtxy/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aam-at/tensorflow,annarev/tensorflow,annarev/tensorflow,yongtang/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gautam1858/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_tf_optimizer,aldian/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,petewarden/tensorflow,tensorflow/tensorflow-pywrap_saved_model,sarvex/tensorflow,petewarden/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,annarev/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,gautam1858/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,yongtang/tensorflow,aam-at/tensorflow,tensorflow/tensorflow,Intel-Corporation/tensorflow,freedomtan/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,paolodedios/tensorflow,cxxgtxy/tensorflow,sarvex/tensorflow,frreiss/tensorflow-fred,annarev/tensorflow,aldian/tensorflow,Intel-Corporation/tensorflow,freedomtan/tensorflow,aam-at/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,aam-at/tensorflow,annarev/tensorflow,aldian/tensorflow,aam-at/tensorflow,davidzchen/tensorflow,annarev/tensorflow,Intel-tensorflow/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-pywrap_tf_optimizer,gautam1858/tensorflow,annarev/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-Corporation/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,freedomtan/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,cxxgtxy/tensorflow,freedomtan/tensorflow,petewarden/tensorflow,karllessard/tensorflow,gautam1858/tensorflow,yongtang/tensorflow,yongtang/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,paolodedios/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_saved_model,sarvex/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,Intel-Corporation/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,freedomtan/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,yongtang/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,Intel-Corporation/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,aldian/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,annarev/tensorflow,tensorflow/tensorflow,karllessard/tensorflow,aldian/tensorflow,tensorflow/tensorflow,cxxgtxy/tensorflow,paolodedios/tensorflow,annarev/tensorflow,tensorflow/tensorflow,yongtang/tensorflow,paolodedios/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,paolodedios/tensorflow,aam-at/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,Intel-tensorflow/tensorflow,aam-at/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aldian/tensorflow,davidzchen/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gautam1858/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_saved_model,davidzchen/tensorflow,Intel-Corporation/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,petewarden/tensorflow,freedomtan/tensorflow,paolodedios/tensorflow,karllessard/tensorflow,aldian/tensorflow,petewarden/tensorflow,petewarden/tensorflow,karllessard/tensorflow,annarev/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,annarev/tensorflow