  Add the waiting time and cross-replica-sum time to StepInfoResult.
  Add the waiting time and cross-replica-sum time to StepInfoResult.

PiperOrigin-RevId: 191124408

allenlavoie/tensorflow,girving/tensorflow,aldian/tensorflow,ageron/tensorflow,gautam1858/tensorflow,annarev/tensorflow,Intel-Corporation/tensorflow,jalexvig/tensorflow,kevin-coder/tensorflow-fork,yongtang/tensorflow,tensorflow/tensorflow,sarvex/tensorflow,xodus7/tensorflow,eaplatanios/tensorflow,caisq/tensorflow,ghchinoy/tensorflow,dendisuhubdy/tensorflow,ghchinoy/tensorflow,arborh/tensorflow,snnn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jbedorf/tensorflow,karllessard/tensorflow,chemelnucfin/tensorflow,jhseu/tensorflow,petewarden/tensorflow,annarev/tensorflow,tensorflow/tensorflow-pywrap_saved_model,frreiss/tensorflow-fred,drpngx/tensorflow,aselle/tensorflow,dancingdan/tensorflow,caisq/tensorflow,aam-at/tensorflow,hehongliang/tensorflow,gojira/tensorflow,Intel-Corporation/tensorflow,chemelnucfin/tensorflow,hfp/tensorflow-xsmm,xodus7/tensorflow,frreiss/tensorflow-fred,jhseu/tensorflow,chemelnucfin/tensorflow,petewarden/tensorflow,alshedivat/tensorflow,gunan/tensorflow,theflofly/tensorflow,theflofly/tensorflow,Intel-tensorflow/tensorflow,gautam1858/tensorflow,dendisuhubdy/tensorflow,gautam1858/tensorflow,brchiu/tensorflow,manipopopo/tensorflow,freedomtan/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow,jbedorf/tensorflow,alsrgv/tensorflow,aselle/tensorflow,ppwwyyxx/tensorflow,drpngx/tensorflow,ghchinoy/tensorflow,jalexvig/tensorflow,seanli9jan/tensorflow,aldian/tensorflow,jendap/tensorflow,Bismarrck/tensorflow,chemelnucfin/tensorflow,theflofly/tensorflow,DavidNorman/tensorflow,jbedorf/tensorflow,asimshankar/tensorflow,kevin-coder/tensorflow-fork,gunan/tensorflow,paolodedios/tensorflow,yanchen036/tensorflow,ageron/tensorflow,benoitsteiner/tensorflow-xsmm,xodus7/tensorflow,jendap/tensorflow,nburn42/tensorflow,renyi533/tensorflow,karllessard/tensorflow,ZhangXinNan/tensorflow,yanchen036/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,drpngx/tensorflow,yanchen036/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Intel-tensorflow/tensorflow,petewarden/tensorflow,benoitsteiner/tensorflow-xsmm,tensorflow/tensorflow,jbedorf/tensorflow,lukeiwanski/tensorflow,girving/tensorflow,jart/tensorflow,meteorcloudy/tensorflow,girving/tensorflow,kobejean/tensorflow,AnishShah/tensorflow,dongjoon-hyun/tensorflow,hfp/tensorflow-xsmm,paolodedios/tensorflow,theflofly/tensorflow,dancingdan/tensorflow,alshedivat/tensorflow,nburn42/tensorflow,jhseu/tensorflow,meteorcloudy/tensorflow,allenlavoie/tensorflow,karllessard/tensorflow,ZhangXinNan/tensorflow,DavidNorman/tensorflow,davidzchen/tensorflow,alshedivat/tensorflow,eaplatanios/tensorflow,seanli9jan/tensorflow,apark263/tensorflow,snnn/tensorflow,arborh/tensorflow,yongtang/tensorflow,renyi533/tensorflow,jart/tensorflow,adit-chandra/tensorflow,benoitsteiner/tensorflow-xsmm,apark263/tensorflow,ZhangXinNan/tensorflow,yongtang/tensorflow,kevin-coder/tensorflow-fork,yongtang/tensorflow,sarvex/tensorflow,aldian/tensorflow,aam-at/tensorflow,petewarden/tensorflow,kevin-coder/tensorflow-fork,DavidNorman/tensorflow,Intel-Corporation/tensorflow,aam-at/tensorflow,xodus7/tensorflow,hfp/tensorflow-xsmm,renyi533/tensorflow,alsrgv/tensorflow,petewarden/tensorflow,nburn42/tensorflow,gautam1858/tensorflow,hfp/tensorflow-xsmm,seanli9jan/tensorflow,dendisuhubdy/tensorflow,paolodedios/tensorflow,manipopopo/tensorflow,drpngx/tensorflow,jhseu/tensorflow,jhseu/tensorflow,xzturn/tensorflow,dancingdan/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kevin-coder/tensorflow-fork,gautam1858/tensorflow,Bismarrck/tensorflow,snnn/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,alsrgv/tensorflow,frreiss/tensorflow-fred,AnishShah/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,hehongliang/tensorflow,chemelnucfin/tensorflow,kobejean/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,benoitsteiner/tensorflow-xsmm,girving/tensorflow,snnn/tensorflow,karllessard/tensorflow,gunan/tensorflow,Intel-tensorflow/tensorflow,yongtang/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,sarvex/tensorflow,girving/tensorflow,paolodedios/tensorflow,xodus7/tensorflow,alsrgv/tensorflow,hfp/tensorflow-xsmm,ppwwyyxx/tensorflow,petewarden/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,lukeiwanski/tensorflow,gautam1858/tensorflow,jalexvig/tensorflow,apark263/tensorflow,DavidNorman/tensorflow,seanli9jan/tensorflow,Intel-tensorflow/tensorflow,AnishShah/tensorflow,jart/tensorflow,hehongliang/tensorflow,ghchinoy/tensorflow,hfp/tensorflow-xsmm,frreiss/tensorflow-fred,dendisuhubdy/tensorflow,dancingdan/tensorflow,benoitsteiner/tensorflow-xsmm,DavidNorman/tensorflow,ZhangXinNan/tensorflow,AnishShah/tensorflow,aam-at/tensorflow,aam-at/tensorflow,hehongliang/tensorflow,jart/tensorflow,eaplatanios/tensorflow,adit-chandra/tensorflow,gautam1858/tensorflow,asimshankar/tensorflow,manipopopo/tensorflow,freedomtan/tensorflow,adit-chandra/tensorflow,asimshankar/tensorflow,jart/tensorflow,benoitsteiner/tensorflow-xsmm,jendap/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,ppwwyyxx/tensorflow,allenlavoie/tensorflow,apark263/tensorflow,yanchen036/tensorflow,dancingdan/tensorflow,xzturn/tensorflow,jhseu/tensorflow,nburn42/tensorflow,xzturn/tensorflow,tensorflow/tensorflow,gojira/tensorflow,gautam1858/tensorflow,jendap/tensorflow,brchiu/tensorflow,xodus7/tensorflow,brchiu/tensorflow,ageron/tensorflow,annarev/tensorflow,manipopopo/tensorflow,freedomtan/tensorflow,alshedivat/tensorflow,alsrgv/tensorflow,ageron/tensorflow,aam-at/tensorflow,nburn42/tensorflow,meteorcloudy/tensorflow,drpngx/tensorflow,aselle/tensorflow,seanli9jan/tensorflow,sarvex/tensorflow,petewarden/tensorflow,AnishShah/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,allenlavoie/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,renyi533/tensorflow,hehongliang/tensorflow,renyi533/tensorflow,aldian/tensorflow,dendisuhubdy/tensorflow,frreiss/tensorflow-fred,caisq/tensorflow,manipopopo/tensorflow,tensorflow/tensorflow-pywrap_saved_model,arborh/tensorflow,manipopopo/tensorflow,renyi533/tensorflow,xzturn/tensorflow,annarev/tensorflow,kobejean/tensorflow,kevin-coder/tensorflow-fork,Intel-Corporation/tensorflow,arborh/tensorflow,Intel-tensorflow/tensorflow,nburn42/tensorflow,Intel-tensorflow/tensorflow,aldian/tensorflow,jalexvig/tensorflow,xzturn/tensorflow,karllessard/tensorflow,karllessard/tensorflow,allenlavoie/tensorflow,frreiss/tensorflow-fred,ghchinoy/tensorflow,davidzchen/tensorflow,annarev/tensorflow,kobejean/tensorflow,eaplatanios/tensorflow,gunan/tensorflow,frreiss/tensorflow-fred,cxxgtxy/tensorflow,jendap/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow,alsrgv/tensorflow,petewarden/tensorflow,Bismarrck/tensorflow,gunan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ppwwyyxx/tensorflow,jalexvig/tensorflow,seanli9jan/tensorflow,cxxgtxy/tensorflow,kevin-coder/tensorflow-fork,seanli9jan/tensorflow,jbedorf/tensorflow,dongjoon-hyun/tensorflow,gunan/tensorflow,drpngx/tensorflow,ageron/tensorflow,apark263/tensorflow,jbedorf/tensorflow,gojira/tensorflow,caisq/tensorflow,lukeiwanski/tensorflow,alshedivat/tensorflow,Bismarrck/tensorflow,dancingdan/tensorflow,eaplatanios/tensorflow,freedomtan/tensorflow,yanchen036/tensorflow,yanchen036/tensorflow,caisq/tensorflow,freedomtan/tensorflow,adit-chandra/tensorflow,snnn/tensorflow,asimshankar/tensorflow,ghchinoy/tensorflow,eaplatanios/tensorflow,lukeiwanski/tensorflow,ZhangXinNan/tensorflow,hfp/tensorflow-xsmm,dongjoon-hyun/tensorflow,girving/tensorflow,aselle/tensorflow,davidzchen/tensorflow,xodus7/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,paolodedios/tensorflow,ageron/tensorflow,renyi533/tensorflow,lukeiwanski/tensorflow,dongjoon-hyun/tensorflow,dancingdan/tensorflow,kobejean/tensorflow,lukeiwanski/tensorflow,Bismarrck/tensorflow,asimshankar/tensorflow,paolodedios/tensorflow,yongtang/tensorflow,dancingdan/tensorflow,xzturn/tensorflow,arborh/tensorflow,brchiu/tensorflow,meteorcloudy/tensorflow,alsrgv/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aam-at/tensorflow,davidzchen/tensorflow,yongtang/tensorflow,alshedivat/tensorflow,girving/tensorflow,eaplatanios/tensorflow,jalexvig/tensorflow,jhseu/tensorflow,brchiu/tensorflow,ghchinoy/tensorflow,davidzchen/tensorflow,jbedorf/tensorflow,ageron/tensorflow,meteorcloudy/tensorflow,gunan/tensorflow,freedomtan/tensorflow,frreiss/tensorflow-fred,ghchinoy/tensorflow,DavidNorman/tensorflow,hfp/tensorflow-xsmm,allenlavoie/tensorflow,theflofly/tensorflow,Bismarrck/tensorflow,aselle/tensorflow,paolodedios/tensorflow,brchiu/tensorflow,theflofly/tensorflow,snnn/tensorflow,apark263/tensorflow,eaplatanios/tensorflow,xzturn/tensorflow,drpngx/tensorflow,gojira/tensorflow,DavidNorman/tensorflow,ageron/tensorflow,jalexvig/tensorflow,gojira/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,brchiu/tensorflow,girving/tensorflow,AnishShah/tensorflow,jart/tensorflow,kevin-coder/tensorflow-fork,AnishShah/tensorflow,jbedorf/tensorflow,xzturn/tensorflow,xodus7/tensorflow,jart/tensorflow,gunan/tensorflow,ppwwyyxx/tensorflow,girving/tensorflow,jendap/tensorflow,jendap/tensorflow,apark263/tensorflow,brchiu/tensorflow,benoitsteiner/tensorflow-xsmm,sarvex/tensorflow,seanli9jan/tensorflow,caisq/tensorflow,Bismarrck/tensorflow,cxxgtxy/tensorflow,petewarden/tensorflow,benoitsteiner/tensorflow-xsmm,sarvex/tensorflow,girving/tensorflow,jendap/tensorflow,xodus7/tensorflow,ghchinoy/tensorflow,hfp/tensorflow-xsmm,aselle/tensorflow,manipopopo/tensorflow,dancingdan/tensorflow,manipopopo/tensorflow,jalexvig/tensorflow,lukeiwanski/tensorflow,dendisuhubdy/tensorflow,meteorcloudy/tensorflow,annarev/tensorflow,dongjoon-hyun/tensorflow,jbedorf/tensorflow,alsrgv/tensorflow,arborh/tensorflow,davidzchen/tensorflow,benoitsteiner/tensorflow-xsmm,caisq/tensorflow,seanli9jan/tensorflow,karllessard/tensorflow,tensorflow/tensorflow,ZhangXinNan/tensorflow,asimshankar/tensorflow,arborh/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gojira/tensorflow,ppwwyyxx/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,AnishShah/tensorflow,jbedorf/tensorflow,DavidNorman/tensorflow,lukeiwanski/tensorflow,eaplatanios/tensorflow,alshedivat/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,asimshankar/tensorflow,cxxgtxy/tensorflow,gautam1858/tensorflow,meteorcloudy/tensorflow,freedomtan/tensorflow,davidzchen/tensorflow,adit-chandra/tensorflow,gojira/tensorflow,frreiss/tensorflow-fred,apark263/tensorflow,theflofly/tensorflow,renyi533/tensorflow,ZhangXinNan/tensorflow,karllessard/tensorflow,kobejean/tensorflow,ZhangXinNan/tensorflow,gautam1858/tensorflow,freedomtan/tensorflow,kevin-coder/tensorflow-fork,Intel-Corporation/tensorflow,dancingdan/tensorflow,arborh/tensorflow,meteorcloudy/tensorflow,manipopopo/tensorflow,arborh/tensorflow,paolodedios/tensorflow,DavidNorman/tensorflow,arborh/tensorflow,jbedorf/tensorflow,renyi533/tensorflow,drpngx/tensorflow,ghchinoy/tensorflow,nburn42/tensorflow,DavidNorman/tensorflow,jhseu/tensorflow,Intel-tensorflow/tensorflow,frreiss/tensorflow-fred,chemelnucfin/tensorflow,tensorflow/tensorflow,xzturn/tensorflow,snnn/tensorflow,snnn/tensorflow,petewarden/tensorflow,nburn42/tensorflow,gojira/tensorflow,renyi533/tensorflow,karllessard/tensorflow,dongjoon-hyun/tensorflow,kobejean/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,cxxgtxy/tensorflow,karllessard/tensorflow,jendap/tensorflow,xodus7/tensorflow,tensorflow/tensorflow-pywrap_saved_model,aam-at/tensorflow,jhseu/tensorflow,seanli9jan/tensorflow,lukeiwanski/tensorflow,asimshankar/tensorflow,petewarden/tensorflow,aselle/tensorflow,hehongliang/tensorflow,annarev/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,adit-chandra/tensorflow,davidzchen/tensorflow,AnishShah/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ppwwyyxx/tensorflow,theflofly/tensorflow,theflofly/tensorflow,aldian/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,DavidNorman/tensorflow,aselle/tensorflow,cxxgtxy/tensorflow,jart/tensorflow,chemelnucfin/tensorflow,brchiu/tensorflow,alsrgv/tensorflow,yanchen036/tensorflow,ppwwyyxx/tensorflow,asimshankar/tensorflow,nburn42/tensorflow,jendap/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,dongjoon-hyun/tensorflow,Intel-tensorflow/tensorflow,dendisuhubdy/tensorflow,gautam1858/tensorflow,theflofly/tensorflow,dancingdan/tensorflow,alshedivat/tensorflow,alsrgv/tensorflow,aldian/tensorflow,aselle/tensorflow,nburn42/tensorflow,annarev/tensorflow,renyi533/tensorflow,ZhangXinNan/tensorflow,hfp/tensorflow-xsmm,dongjoon-hyun/tensorflow,snnn/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_saved_model,jart/tensorflow,ageron/tensorflow,allenlavoie/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,jhseu/tensorflow,caisq/tensorflow,lukeiwanski/tensorflow,adit-chandra/tensorflow,adit-chandra/tensorflow,asimshankar/tensorflow,adit-chandra/tensorflow,jhseu/tensorflow,kobejean/tensorflow,annarev/tensorflow,snnn/tensorflow,arborh/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,AnishShah/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-experimental_link_static_libraries_once,benoitsteiner/tensorflow-xsmm,cxxgtxy/tensorflow,freedomtan/tensorflow,paolodedios/tensorflow,gojira/tensorflow,annarev/tensorflow,renyi533/tensorflow,annarev/tensorflow,gojira/tensorflow,aldian/tensorflow,chemelnucfin/tensorflow,alshedivat/tensorflow,yanchen036/tensorflow,allenlavoie/tensorflow,dendisuhubdy/tensorflow,tensorflow/tensorflow,paolodedios/tensorflow,sarvex/tensorflow,brchiu/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,theflofly/tensorflow,jendap/tensorflow,hehongliang/tensorflow,girving/tensorflow,paolodedios/tensorflow,adit-chandra/tensorflow,allenlavoie/tensorflow,Bismarrck/tensorflow,alshedivat/tensorflow,ppwwyyxx/tensorflow,freedomtan/tensorflow,snnn/tensorflow,aselle/tensorflow,caisq/tensorflow,yongtang/tensorflow,davidzchen/tensorflow,asimshankar/tensorflow,ageron/tensorflow,drpngx/tensorflow,allenlavoie/tensorflow,xzturn/tensorflow,brchiu/tensorflow,jart/tensorflow,yongtang/tensorflow,drpngx/tensorflow,dendisuhubdy/tensorflow,xzturn/tensorflow,arborh/tensorflow,theflofly/tensorflow,caisq/tensorflow,alshedivat/tensorflow,gunan/tensorflow,Bismarrck/tensorflow,sarvex/tensorflow,ppwwyyxx/tensorflow,alsrgv/tensorflow,aam-at/tensorflow,ZhangXinNan/tensorflow,ghchinoy/tensorflow,adit-chandra/tensorflow,xodus7/tensorflow,gunan/tensorflow,kobejean/tensorflow,dongjoon-hyun/tensorflow,meteorcloudy/tensorflow,adit-chandra/tensorflow,yongtang/tensorflow,davidzchen/tensorflow,Intel-Corporation/tensorflow,gojira/tensorflow,yongtang/tensorflow,DavidNorman/tensorflow,Bismarrck/tensorflow,aam-at/tensorflow,meteorcloudy/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow,nburn42/tensorflow,kevin-coder/tensorflow-fork,dongjoon-hyun/tensorflow,eaplatanios/tensorflow,jalexvig/tensorflow,apark263/tensorflow,karllessard/tensorflow,gautam1858/tensorflow,benoitsteiner/tensorflow-xsmm,allenlavoie/tensorflow,chemelnucfin/tensorflow,eaplatanios/tensorflow,ppwwyyxx/tensorflow,apark263/tensorflow,hfp/tensorflow-xsmm,freedomtan/tensorflow,manipopopo/tensorflow,ageron/tensorflow,Intel-tensorflow/tensorflow,manipopopo/tensorflow,gunan/tensorflow,AnishShah/tensorflow,xzturn/tensorflow,ageron/tensorflow,kobejean/tensorflow,ZhangXinNan/tensorflow,jalexvig/tensorflow,aselle/tensorflow,dendisuhubdy/tensorflow,chemelnucfin/tensorflow,dongjoon-hyun/tensorflow,Bismarrck/tensorflow,kevin-coder/tensorflow-fork,jhseu/tensorflow,apark263/tensorflow,freedomtan/tensorflow,jalexvig/tensorflow