Introduce "shard" for waiting queue and make it configurable. By default, the behavior is not changed.
Introduce "shard" for waiting queue and make it configurable. By default, the behavior is not changed.

PiperOrigin-RevId: 273594000

aam-at/tensorflow,yongtang/tensorflow,xzturn/tensorflow,ppwwyyxx/tensorflow,jhseu/tensorflow,gunan/tensorflow,tensorflow/tensorflow,yongtang/tensorflow,renyi533/tensorflow,annarev/tensorflow,adit-chandra/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,karllessard/tensorflow,karllessard/tensorflow,DavidNorman/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,sarvex/tensorflow,aldian/tensorflow,Intel-Corporation/tensorflow,karllessard/tensorflow,renyi533/tensorflow,gautam1858/tensorflow,xzturn/tensorflow,freedomtan/tensorflow,adit-chandra/tensorflow,karllessard/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,karllessard/tensorflow,renyi533/tensorflow,jhseu/tensorflow,cxxgtxy/tensorflow,arborh/tensorflow,ppwwyyxx/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow,ppwwyyxx/tensorflow,xzturn/tensorflow,jhseu/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,xzturn/tensorflow,karllessard/tensorflow,xzturn/tensorflow,Intel-Corporation/tensorflow,xzturn/tensorflow,yongtang/tensorflow,aldian/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-Corporation/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ppwwyyxx/tensorflow,arborh/tensorflow,DavidNorman/tensorflow,davidzchen/tensorflow,ppwwyyxx/tensorflow,arborh/tensorflow,tensorflow/tensorflow-pywrap_saved_model,karllessard/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,gautam1858/tensorflow,davidzchen/tensorflow,aldian/tensorflow,renyi533/tensorflow,jhseu/tensorflow,frreiss/tensorflow-fred,davidzchen/tensorflow,renyi533/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow,xzturn/tensorflow,adit-chandra/tensorflow,adit-chandra/tensorflow,davidzchen/tensorflow,arborh/tensorflow,DavidNorman/tensorflow,paolodedios/tensorflow,petewarden/tensorflow,renyi533/tensorflow,annarev/tensorflow,aldian/tensorflow,tensorflow/tensorflow-pywrap_saved_model,renyi533/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,gautam1858/tensorflow,yongtang/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,cxxgtxy/tensorflow,jhseu/tensorflow,annarev/tensorflow,xzturn/tensorflow,aldian/tensorflow,petewarden/tensorflow,gunan/tensorflow,paolodedios/tensorflow,annarev/tensorflow,freedomtan/tensorflow,aam-at/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,annarev/tensorflow,Intel-Corporation/tensorflow,yongtang/tensorflow,adit-chandra/tensorflow,gunan/tensorflow,adit-chandra/tensorflow,aam-at/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_tf_optimizer,ppwwyyxx/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,ppwwyyxx/tensorflow,adit-chandra/tensorflow,freedomtan/tensorflow,DavidNorman/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,annarev/tensorflow,petewarden/tensorflow,yongtang/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,jhseu/tensorflow,arborh/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,gautam1858/tensorflow,annarev/tensorflow,gunan/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aldian/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow,jhseu/tensorflow,yongtang/tensorflow,adit-chandra/tensorflow,petewarden/tensorflow,aldian/tensorflow,aam-at/tensorflow,petewarden/tensorflow,Intel-tensorflow/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow,aam-at/tensorflow,aam-at/tensorflow,arborh/tensorflow,Intel-tensorflow/tensorflow,ppwwyyxx/tensorflow,Intel-tensorflow/tensorflow,adit-chandra/tensorflow,davidzchen/tensorflow,cxxgtxy/tensorflow,gunan/tensorflow,annarev/tensorflow,Intel-tensorflow/tensorflow,DavidNorman/tensorflow,jhseu/tensorflow,sarvex/tensorflow,karllessard/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,xzturn/tensorflow,sarvex/tensorflow,freedomtan/tensorflow,paolodedios/tensorflow,frreiss/tensorflow-fred,gunan/tensorflow,annarev/tensorflow,ppwwyyxx/tensorflow,gunan/tensorflow,arborh/tensorflow,frreiss/tensorflow-fred,Intel-tensorflow/tensorflow,petewarden/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,gunan/tensorflow,davidzchen/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow,jhseu/tensorflow,adit-chandra/tensorflow,ppwwyyxx/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,annarev/tensorflow,freedomtan/tensorflow,jhseu/tensorflow,petewarden/tensorflow,aam-at/tensorflow,xzturn/tensorflow,Intel-Corporation/tensorflow,aam-at/tensorflow,davidzchen/tensorflow,DavidNorman/tensorflow,renyi533/tensorflow,tensorflow/tensorflow,DavidNorman/tensorflow,adit-chandra/tensorflow,cxxgtxy/tensorflow,petewarden/tensorflow,davidzchen/tensorflow,aam-at/tensorflow,aldian/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_saved_model,karllessard/tensorflow,cxxgtxy/tensorflow,arborh/tensorflow,frreiss/tensorflow-fred,renyi533/tensorflow,renyi533/tensorflow,sarvex/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,freedomtan/tensorflow,xzturn/tensorflow,petewarden/tensorflow,annarev/tensorflow,cxxgtxy/tensorflow,ppwwyyxx/tensorflow,gunan/tensorflow,gunan/tensorflow,paolodedios/tensorflow,DavidNorman/tensorflow,arborh/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-experimental_link_static_libraries_once,paolodedios/tensorflow,davidzchen/tensorflow,arborh/tensorflow,arborh/tensorflow,petewarden/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,DavidNorman/tensorflow,Intel-tensorflow/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,renyi533/tensorflow,adit-chandra/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,xzturn/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,jhseu/tensorflow,sarvex/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,cxxgtxy/tensorflow,davidzchen/tensorflow,Intel-Corporation/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gunan/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,paolodedios/tensorflow,sarvex/tensorflow