Improve the latency of small `tf.concat()` operations.
Improve the latency of small `tf.concat()` operations.

Avoid copying each input `Tensor` object from the `OpInputList`, and
instead take a const reference. This avoids the need to run the
`Tensor` destructor at the end of each iteration.

PiperOrigin-RevId: 203326683

caisq/tensorflow,theflofly/tensorflow,ppwwyyxx/tensorflow,snnn/tensorflow,alsrgv/tensorflow,dancingdan/tensorflow,freedomtan/tensorflow,chemelnucfin/tensorflow,aam-at/tensorflow,alsrgv/tensorflow,annarev/tensorflow,annarev/tensorflow,karllessard/tensorflow,jalexvig/tensorflow,chemelnucfin/tensorflow,hfp/tensorflow-xsmm,caisq/tensorflow,Intel-Corporation/tensorflow,jhseu/tensorflow,ZhangXinNan/tensorflow,alsrgv/tensorflow,hfp/tensorflow-xsmm,Bismarrck/tensorflow,chemelnucfin/tensorflow,girving/tensorflow,sarvex/tensorflow,brchiu/tensorflow,ghchinoy/tensorflow,jendap/tensorflow,AnishShah/tensorflow,dancingdan/tensorflow,jart/tensorflow,frreiss/tensorflow-fred,yongtang/tensorflow,chemelnucfin/tensorflow,xodus7/tensorflow,xzturn/tensorflow,hehongliang/tensorflow,ghchinoy/tensorflow,aselle/tensorflow,hfp/tensorflow-xsmm,kobejean/tensorflow,paolodedios/tensorflow,Intel-Corporation/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gautam1858/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,yongtang/tensorflow,arborh/tensorflow,davidzchen/tensorflow,aselle/tensorflow,alshedivat/tensorflow,hfp/tensorflow-xsmm,petewarden/tensorflow,xodus7/tensorflow,apark263/tensorflow,chemelnucfin/tensorflow,jbedorf/tensorflow,davidzchen/tensorflow,jart/tensorflow,petewarden/tensorflow,ZhangXinNan/tensorflow,ghchinoy/tensorflow,ppwwyyxx/tensorflow,ageron/tensorflow,kobejean/tensorflow,dancingdan/tensorflow,karllessard/tensorflow,annarev/tensorflow,AnishShah/tensorflow,chemelnucfin/tensorflow,brchiu/tensorflow,adit-chandra/tensorflow,jendap/tensorflow,ZhangXinNan/tensorflow,ghchinoy/tensorflow,caisq/tensorflow,AnishShah/tensorflow,paolodedios/tensorflow,karllessard/tensorflow,karllessard/tensorflow,gunan/tensorflow,frreiss/tensorflow-fred,kevin-coder/tensorflow-fork,alshedivat/tensorflow,jendap/tensorflow,AnishShah/tensorflow,apark263/tensorflow,xodus7/tensorflow,ZhangXinNan/tensorflow,chemelnucfin/tensorflow,ppwwyyxx/tensorflow,seanli9jan/tensorflow,hehongliang/tensorflow,snnn/tensorflow,girving/tensorflow,jbedorf/tensorflow,dongjoon-hyun/tensorflow,cxxgtxy/tensorflow,manipopopo/tensorflow,theflofly/tensorflow,tensorflow/tensorflow,ageron/tensorflow,annarev/tensorflow,Intel-Corporation/tensorflow,hehongliang/tensorflow,alshedivat/tensorflow,theflofly/tensorflow,AnishShah/tensorflow,jart/tensorflow,ghchinoy/tensorflow,manipopopo/tensorflow,caisq/tensorflow,dancingdan/tensorflow,DavidNorman/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow-pywrap_saved_model,AnishShah/tensorflow,xzturn/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-pywrap_saved_model,snnn/tensorflow,gautam1858/tensorflow,kevin-coder/tensorflow-fork,alsrgv/tensorflow,ZhangXinNan/tensorflow,ppwwyyxx/tensorflow,jhseu/tensorflow,aam-at/tensorflow,jbedorf/tensorflow,ZhangXinNan/tensorflow,brchiu/tensorflow,tensorflow/tensorflow,alshedivat/tensorflow,petewarden/tensorflow,dongjoon-hyun/tensorflow,xodus7/tensorflow,gautam1858/tensorflow,alsrgv/tensorflow,jalexvig/tensorflow,hfp/tensorflow-xsmm,gunan/tensorflow,apark263/tensorflow,aldian/tensorflow,brchiu/tensorflow,seanli9jan/tensorflow,alshedivat/tensorflow,caisq/tensorflow,petewarden/tensorflow,ageron/tensorflow,sarvex/tensorflow,alsrgv/tensorflow,freedomtan/tensorflow,annarev/tensorflow,arborh/tensorflow,renyi533/tensorflow,aam-at/tensorflow,kevin-coder/tensorflow-fork,kevin-coder/tensorflow-fork,adit-chandra/tensorflow,ageron/tensorflow,davidzchen/tensorflow,gunan/tensorflow,cxxgtxy/tensorflow,jbedorf/tensorflow,davidzchen/tensorflow,hfp/tensorflow-xsmm,kobejean/tensorflow,ageron/tensorflow,paolodedios/tensorflow,dongjoon-hyun/tensorflow,jart/tensorflow,freedomtan/tensorflow,apark263/tensorflow,petewarden/tensorflow,tensorflow/tensorflow-pywrap_saved_model,aselle/tensorflow,seanli9jan/tensorflow,cxxgtxy/tensorflow,gunan/tensorflow,adit-chandra/tensorflow,davidzchen/tensorflow,annarev/tensorflow,alsrgv/tensorflow,asimshankar/tensorflow,gautam1858/tensorflow,asimshankar/tensorflow,kobejean/tensorflow,Bismarrck/tensorflow,DavidNorman/tensorflow,jart/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,brchiu/tensorflow,chemelnucfin/tensorflow,aam-at/tensorflow,girving/tensorflow,aam-at/tensorflow,seanli9jan/tensorflow,paolodedios/tensorflow,theflofly/tensorflow,jalexvig/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,DavidNorman/tensorflow,ageron/tensorflow,chemelnucfin/tensorflow,adit-chandra/tensorflow,Intel-Corporation/tensorflow,jart/tensorflow,paolodedios/tensorflow,brchiu/tensorflow,Intel-tensorflow/tensorflow,renyi533/tensorflow,kevin-coder/tensorflow-fork,Bismarrck/tensorflow,DavidNorman/tensorflow,brchiu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kobejean/tensorflow,adit-chandra/tensorflow,seanli9jan/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,arborh/tensorflow,alshedivat/tensorflow,Bismarrck/tensorflow,tensorflow/tensorflow,AnishShah/tensorflow,adit-chandra/tensorflow,karllessard/tensorflow,freedomtan/tensorflow,xodus7/tensorflow,gunan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,xodus7/tensorflow,xzturn/tensorflow,jalexvig/tensorflow,xodus7/tensorflow,hfp/tensorflow-xsmm,sarvex/tensorflow,kobejean/tensorflow,dancingdan/tensorflow,karllessard/tensorflow,davidzchen/tensorflow,caisq/tensorflow,chemelnucfin/tensorflow,Intel-Corporation/tensorflow,brchiu/tensorflow,dancingdan/tensorflow,yongtang/tensorflow,ghchinoy/tensorflow,snnn/tensorflow,Intel-Corporation/tensorflow,kobejean/tensorflow,kevin-coder/tensorflow-fork,arborh/tensorflow,asimshankar/tensorflow,aldian/tensorflow,dongjoon-hyun/tensorflow,adit-chandra/tensorflow,gunan/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,sarvex/tensorflow,seanli9jan/tensorflow,Intel-tensorflow/tensorflow,ghchinoy/tensorflow,cxxgtxy/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,alshedivat/tensorflow,xodus7/tensorflow,caisq/tensorflow,tensorflow/tensorflow-pywrap_saved_model,aam-at/tensorflow,tensorflow/tensorflow-pywrap_saved_model,girving/tensorflow,davidzchen/tensorflow,manipopopo/tensorflow,apark263/tensorflow,hfp/tensorflow-xsmm,freedomtan/tensorflow,jart/tensorflow,jart/tensorflow,asimshankar/tensorflow,gautam1858/tensorflow,renyi533/tensorflow,brchiu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,girving/tensorflow,hehongliang/tensorflow,dongjoon-hyun/tensorflow,sarvex/tensorflow,snnn/tensorflow,davidzchen/tensorflow,kevin-coder/tensorflow-fork,Intel-tensorflow/tensorflow,petewarden/tensorflow,alsrgv/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow,adit-chandra/tensorflow,petewarden/tensorflow,hfp/tensorflow-xsmm,ppwwyyxx/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,kobejean/tensorflow,ZhangXinNan/tensorflow,dancingdan/tensorflow,jendap/tensorflow,gunan/tensorflow,annarev/tensorflow,manipopopo/tensorflow,adit-chandra/tensorflow,kevin-coder/tensorflow-fork,jbedorf/tensorflow,dongjoon-hyun/tensorflow,DavidNorman/tensorflow,xzturn/tensorflow,hehongliang/tensorflow,alshedivat/tensorflow,xodus7/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,xzturn/tensorflow,petewarden/tensorflow,brchiu/tensorflow,ZhangXinNan/tensorflow,aselle/tensorflow,yongtang/tensorflow,jhseu/tensorflow,aldian/tensorflow,apark263/tensorflow,jhseu/tensorflow,apark263/tensorflow,gautam1858/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kevin-coder/tensorflow-fork,jhseu/tensorflow,aam-at/tensorflow,gunan/tensorflow,ageron/tensorflow,gautam1858/tensorflow,jendap/tensorflow,ppwwyyxx/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,dongjoon-hyun/tensorflow,AnishShah/tensorflow,jalexvig/tensorflow,aldian/tensorflow,Intel-Corporation/tensorflow,girving/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow,gautam1858/tensorflow,jbedorf/tensorflow,karllessard/tensorflow,dongjoon-hyun/tensorflow,apark263/tensorflow,theflofly/tensorflow,xzturn/tensorflow,jendap/tensorflow,snnn/tensorflow,seanli9jan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,girving/tensorflow,petewarden/tensorflow,ageron/tensorflow,girving/tensorflow,chemelnucfin/tensorflow,annarev/tensorflow,dongjoon-hyun/tensorflow,annarev/tensorflow,snnn/tensorflow,xzturn/tensorflow,asimshankar/tensorflow,arborh/tensorflow,xodus7/tensorflow,alsrgv/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,ghchinoy/tensorflow,tensorflow/tensorflow,alsrgv/tensorflow,jbedorf/tensorflow,aselle/tensorflow,asimshankar/tensorflow,DavidNorman/tensorflow,DavidNorman/tensorflow,yongtang/tensorflow,ZhangXinNan/tensorflow,asimshankar/tensorflow,jalexvig/tensorflow,frreiss/tensorflow-fred,yongtang/tensorflow,aam-at/tensorflow,aldian/tensorflow,aldian/tensorflow,aselle/tensorflow,paolodedios/tensorflow,paolodedios/tensorflow,ghchinoy/tensorflow,ageron/tensorflow,hehongliang/tensorflow,jendap/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,DavidNorman/tensorflow,DavidNorman/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,gautam1858/tensorflow,xzturn/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-pywrap_tf_optimizer,manipopopo/tensorflow,xzturn/tensorflow,jendap/tensorflow,ZhangXinNan/tensorflow,manipopopo/tensorflow,frreiss/tensorflow-fred,arborh/tensorflow,Bismarrck/tensorflow,seanli9jan/tensorflow,seanli9jan/tensorflow,aselle/tensorflow,ageron/tensorflow,adit-chandra/tensorflow,renyi533/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,frreiss/tensorflow-fred,karllessard/tensorflow,jhseu/tensorflow,apark263/tensorflow,girving/tensorflow,aldian/tensorflow,paolodedios/tensorflow,aam-at/tensorflow,Intel-tensorflow/tensorflow,davidzchen/tensorflow,kevin-coder/tensorflow-fork,tensorflow/tensorflow-pywrap_tf_optimizer,paolodedios/tensorflow,jalexvig/tensorflow,ghchinoy/tensorflow,arborh/tensorflow,kobejean/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,seanli9jan/tensorflow,snnn/tensorflow,dancingdan/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,caisq/tensorflow,adit-chandra/tensorflow,gautam1858/tensorflow,ageron/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jalexvig/tensorflow,tensorflow/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,snnn/tensorflow,yongtang/tensorflow,Bismarrck/tensorflow,girving/tensorflow,frreiss/tensorflow-fred,aam-at/tensorflow,Bismarrck/tensorflow,jhseu/tensorflow,renyi533/tensorflow,jendap/tensorflow,renyi533/tensorflow,apark263/tensorflow,alsrgv/tensorflow,annarev/tensorflow,frreiss/tensorflow-fred,petewarden/tensorflow,DavidNorman/tensorflow,aselle/tensorflow,tensorflow/tensorflow,ageron/tensorflow,theflofly/tensorflow,jendap/tensorflow,aam-at/tensorflow,aam-at/tensorflow,cxxgtxy/tensorflow,Bismarrck/tensorflow,xodus7/tensorflow,sarvex/tensorflow,cxxgtxy/tensorflow,jbedorf/tensorflow,jbedorf/tensorflow,theflofly/tensorflow,jhseu/tensorflow,hfp/tensorflow-xsmm,jalexvig/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,apark263/tensorflow,jart/tensorflow,paolodedios/tensorflow,caisq/tensorflow,manipopopo/tensorflow,Bismarrck/tensorflow,ppwwyyxx/tensorflow,chemelnucfin/tensorflow,renyi533/tensorflow,jalexvig/tensorflow,arborh/tensorflow,Bismarrck/tensorflow,AnishShah/tensorflow,alsrgv/tensorflow,davidzchen/tensorflow,asimshankar/tensorflow,manipopopo/tensorflow,ghchinoy/tensorflow,manipopopo/tensorflow,Bismarrck/tensorflow,ppwwyyxx/tensorflow,hfp/tensorflow-xsmm,jendap/tensorflow,jart/tensorflow,ghchinoy/tensorflow,brchiu/tensorflow,aldian/tensorflow,kobejean/tensorflow,Intel-tensorflow/tensorflow,hehongliang/tensorflow,jbedorf/tensorflow,karllessard/tensorflow,petewarden/tensorflow,renyi533/tensorflow,adit-chandra/tensorflow,alshedivat/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,dancingdan/tensorflow,DavidNorman/tensorflow,kevin-coder/tensorflow-fork,gunan/tensorflow,manipopopo/tensorflow,aselle/tensorflow,caisq/tensorflow,Intel-tensorflow/tensorflow,arborh/tensorflow,theflofly/tensorflow,ppwwyyxx/tensorflow,jhseu/tensorflow,tensorflow/tensorflow,aselle/tensorflow,seanli9jan/tensorflow,jalexvig/tensorflow,davidzchen/tensorflow,yongtang/tensorflow,snnn/tensorflow,cxxgtxy/tensorflow,snnn/tensorflow,tensorflow/tensorflow,theflofly/tensorflow,renyi533/tensorflow,yongtang/tensorflow,theflofly/tensorflow,Intel-tensorflow/tensorflow,ppwwyyxx/tensorflow,theflofly/tensorflow,xzturn/tensorflow,aselle/tensorflow,karllessard/tensorflow,jbedorf/tensorflow,karllessard/tensorflow,arborh/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-Corporation/tensorflow,alshedivat/tensorflow,tensorflow/tensorflow-pywrap_saved_model,manipopopo/tensorflow,annarev/tensorflow,renyi533/tensorflow,gunan/tensorflow,theflofly/tensorflow,AnishShah/tensorflow,dongjoon-hyun/tensorflow,girving/tensorflow,AnishShah/tensorflow,asimshankar/tensorflow,tensorflow/tensorflow,xzturn/tensorflow,asimshankar/tensorflow,jhseu/tensorflow,davidzchen/tensorflow,freedomtan/tensorflow,alshedivat/tensorflow,xzturn/tensorflow,freedomtan/tensorflow,arborh/tensorflow,jhseu/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,ppwwyyxx/tensorflow,yongtang/tensorflow,ZhangXinNan/tensorflow,renyi533/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,dongjoon-hyun/tensorflow