[XLA] Don't call Literal::Get in HloEvaluator's convolution loop.
[XLA] Don't call Literal::Get in HloEvaluator's convolution loop.

This speeds up the implementation of conv because Literal::Get calls
Literal::Piece::data, which is relatively slow.

Instead, we call Literal::Data() once and cache the result.

Before: ConvolutionTest/0.StridedFilter (59094 ms)
After:  ConvolutionTest/0.StridedFilter (41812 ms)

Speedup: 59/42 = 1.4x
PiperOrigin-RevId: 191830741

annarev/tensorflow,aam-at/tensorflow,annarev/tensorflow,ZhangXinNan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,apark263/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ghchinoy/tensorflow,ppwwyyxx/tensorflow,jart/tensorflow,ghchinoy/tensorflow,freedomtan/tensorflow,aam-at/tensorflow,DavidNorman/tensorflow,ppwwyyxx/tensorflow,DavidNorman/tensorflow,cxxgtxy/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_saved_model,allenlavoie/tensorflow,aldian/tensorflow,dendisuhubdy/tensorflow,tensorflow/tensorflow,alshedivat/tensorflow,frreiss/tensorflow-fred,adit-chandra/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,DavidNorman/tensorflow,brchiu/tensorflow,snnn/tensorflow,jart/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,allenlavoie/tensorflow,jhseu/tensorflow,caisq/tensorflow,gautam1858/tensorflow,eaplatanios/tensorflow,dancingdan/tensorflow,paolodedios/tensorflow,gautam1858/tensorflow,allenlavoie/tensorflow,dendisuhubdy/tensorflow,karllessard/tensorflow,kobejean/tensorflow,alsrgv/tensorflow,ppwwyyxx/tensorflow,ZhangXinNan/tensorflow,frreiss/tensorflow-fred,caisq/tensorflow,petewarden/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gojira/tensorflow,sarvex/tensorflow,jhseu/tensorflow,frreiss/tensorflow-fred,nburn42/tensorflow,lukeiwanski/tensorflow,chemelnucfin/tensorflow,ppwwyyxx/tensorflow,DavidNorman/tensorflow,paolodedios/tensorflow,brchiu/tensorflow,jendap/tensorflow,freedomtan/tensorflow,annarev/tensorflow,Bismarrck/tensorflow,freedomtan/tensorflow,Intel-tensorflow/tensorflow,jart/tensorflow,jhseu/tensorflow,drpngx/tensorflow,aselle/tensorflow,Bismarrck/tensorflow,jbedorf/tensorflow,drpngx/tensorflow,davidzchen/tensorflow,petewarden/tensorflow,jhseu/tensorflow,aselle/tensorflow,xodus7/tensorflow,sarvex/tensorflow,kobejean/tensorflow,nburn42/tensorflow,lukeiwanski/tensorflow,hehongliang/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,seanli9jan/tensorflow,yanchen036/tensorflow,hfp/tensorflow-xsmm,adit-chandra/tensorflow,davidzchen/tensorflow,AnishShah/tensorflow,aldian/tensorflow,alshedivat/tensorflow,Bismarrck/tensorflow,meteorcloudy/tensorflow,alsrgv/tensorflow,jart/tensorflow,jbedorf/tensorflow,manipopopo/tensorflow,eaplatanios/tensorflow,frreiss/tensorflow-fred,brchiu/tensorflow,apark263/tensorflow,Intel-tensorflow/tensorflow,petewarden/tensorflow,theflofly/tensorflow,brchiu/tensorflow,dancingdan/tensorflow,petewarden/tensorflow,girving/tensorflow,ZhangXinNan/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,jendap/tensorflow,jbedorf/tensorflow,jendap/tensorflow,benoitsteiner/tensorflow-xsmm,manipopopo/tensorflow,manipopopo/tensorflow,dongjoon-hyun/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_saved_model,xodus7/tensorflow,xodus7/tensorflow,yongtang/tensorflow,alshedivat/tensorflow,alsrgv/tensorflow,jendap/tensorflow,Intel-Corporation/tensorflow,seanli9jan/tensorflow,arborh/tensorflow,seanli9jan/tensorflow,theflofly/tensorflow,frreiss/tensorflow-fred,jart/tensorflow,drpngx/tensorflow,renyi533/tensorflow,ageron/tensorflow,asimshankar/tensorflow,adit-chandra/tensorflow,snnn/tensorflow,hehongliang/tensorflow,nburn42/tensorflow,jendap/tensorflow,yongtang/tensorflow,alshedivat/tensorflow,freedomtan/tensorflow,jbedorf/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,karllessard/tensorflow,ZhangXinNan/tensorflow,adit-chandra/tensorflow,allenlavoie/tensorflow,apark263/tensorflow,dendisuhubdy/tensorflow,eaplatanios/tensorflow,dendisuhubdy/tensorflow,dongjoon-hyun/tensorflow,Intel-tensorflow/tensorflow,girving/tensorflow,dongjoon-hyun/tensorflow,annarev/tensorflow,nburn42/tensorflow,kevin-coder/tensorflow-fork,adit-chandra/tensorflow,AnishShah/tensorflow,frreiss/tensorflow-fred,gunan/tensorflow,yongtang/tensorflow,jalexvig/tensorflow,adit-chandra/tensorflow,paolodedios/tensorflow,dongjoon-hyun/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,ageron/tensorflow,aselle/tensorflow,gautam1858/tensorflow,alsrgv/tensorflow,jalexvig/tensorflow,gojira/tensorflow,aldian/tensorflow,AnishShah/tensorflow,kevin-coder/tensorflow-fork,aam-at/tensorflow,sarvex/tensorflow,gunan/tensorflow,paolodedios/tensorflow,kobejean/tensorflow,drpngx/tensorflow,jendap/tensorflow,theflofly/tensorflow,lukeiwanski/tensorflow,arborh/tensorflow,drpngx/tensorflow,eaplatanios/tensorflow,tensorflow/tensorflow,arborh/tensorflow,ghchinoy/tensorflow,xodus7/tensorflow,frreiss/tensorflow-fred,frreiss/tensorflow-fred,seanli9jan/tensorflow,dancingdan/tensorflow,kobejean/tensorflow,tensorflow/tensorflow-pywrap_saved_model,lukeiwanski/tensorflow,brchiu/tensorflow,benoitsteiner/tensorflow-xsmm,drpngx/tensorflow,kevin-coder/tensorflow-fork,renyi533/tensorflow,frreiss/tensorflow-fred,gojira/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,chemelnucfin/tensorflow,theflofly/tensorflow,dendisuhubdy/tensorflow,ppwwyyxx/tensorflow,petewarden/tensorflow,ageron/tensorflow,tensorflow/tensorflow-pywrap_saved_model,meteorcloudy/tensorflow,girving/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,asimshankar/tensorflow,ageron/tensorflow,Bismarrck/tensorflow,alshedivat/tensorflow,seanli9jan/tensorflow,gautam1858/tensorflow,meteorcloudy/tensorflow,gunan/tensorflow,sarvex/tensorflow,chemelnucfin/tensorflow,hfp/tensorflow-xsmm,adit-chandra/tensorflow,snnn/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jart/tensorflow,aam-at/tensorflow,karllessard/tensorflow,hfp/tensorflow-xsmm,hehongliang/tensorflow,theflofly/tensorflow,yongtang/tensorflow,adit-chandra/tensorflow,manipopopo/tensorflow,dongjoon-hyun/tensorflow,caisq/tensorflow,gunan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,ghchinoy/tensorflow,aldian/tensorflow,chemelnucfin/tensorflow,gojira/tensorflow,ghchinoy/tensorflow,aselle/tensorflow,tensorflow/tensorflow-pywrap_saved_model,renyi533/tensorflow,alsrgv/tensorflow,kobejean/tensorflow,seanli9jan/tensorflow,nburn42/tensorflow,ZhangXinNan/tensorflow,ghchinoy/tensorflow,ageron/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,Bismarrck/tensorflow,tensorflow/tensorflow,karllessard/tensorflow,kevin-coder/tensorflow-fork,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,renyi533/tensorflow,tensorflow/tensorflow,drpngx/tensorflow,gojira/tensorflow,drpngx/tensorflow,jbedorf/tensorflow,kobejean/tensorflow,kevin-coder/tensorflow-fork,xodus7/tensorflow,seanli9jan/tensorflow,sarvex/tensorflow,alsrgv/tensorflow,aam-at/tensorflow,Intel-tensorflow/tensorflow,apark263/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gautam1858/tensorflow,annarev/tensorflow,karllessard/tensorflow,apark263/tensorflow,dancingdan/tensorflow,eaplatanios/tensorflow,jhseu/tensorflow,xodus7/tensorflow,cxxgtxy/tensorflow,theflofly/tensorflow,benoitsteiner/tensorflow-xsmm,arborh/tensorflow,aselle/tensorflow,tensorflow/tensorflow-pywrap_saved_model,kobejean/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,meteorcloudy/tensorflow,seanli9jan/tensorflow,frreiss/tensorflow-fred,gunan/tensorflow,meteorcloudy/tensorflow,hehongliang/tensorflow,Intel-tensorflow/tensorflow,eaplatanios/tensorflow,xodus7/tensorflow,jbedorf/tensorflow,allenlavoie/tensorflow,benoitsteiner/tensorflow-xsmm,frreiss/tensorflow-fred,yongtang/tensorflow,yanchen036/tensorflow,freedomtan/tensorflow,apark263/tensorflow,jendap/tensorflow,nburn42/tensorflow,dongjoon-hyun/tensorflow,davidzchen/tensorflow,aldian/tensorflow,alsrgv/tensorflow,annarev/tensorflow,snnn/tensorflow,karllessard/tensorflow,jendap/tensorflow,dendisuhubdy/tensorflow,hehongliang/tensorflow,yongtang/tensorflow,jhseu/tensorflow,AnishShah/tensorflow,Intel-Corporation/tensorflow,snnn/tensorflow,benoitsteiner/tensorflow-xsmm,ZhangXinNan/tensorflow,DavidNorman/tensorflow,cxxgtxy/tensorflow,jendap/tensorflow,annarev/tensorflow,renyi533/tensorflow,apark263/tensorflow,brchiu/tensorflow,Bismarrck/tensorflow,manipopopo/tensorflow,kevin-coder/tensorflow-fork,adit-chandra/tensorflow,renyi533/tensorflow,jalexvig/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,nburn42/tensorflow,tensorflow/tensorflow,aselle/tensorflow,nburn42/tensorflow,jbedorf/tensorflow,arborh/tensorflow,benoitsteiner/tensorflow-xsmm,brchiu/tensorflow,gunan/tensorflow,dongjoon-hyun/tensorflow,meteorcloudy/tensorflow,yanchen036/tensorflow,tensorflow/tensorflow,paolodedios/tensorflow,renyi533/tensorflow,manipopopo/tensorflow,arborh/tensorflow,cxxgtxy/tensorflow,chemelnucfin/tensorflow,jhseu/tensorflow,snnn/tensorflow,benoitsteiner/tensorflow-xsmm,snnn/tensorflow,petewarden/tensorflow,jhseu/tensorflow,paolodedios/tensorflow,meteorcloudy/tensorflow,theflofly/tensorflow,tensorflow/tensorflow,manipopopo/tensorflow,tensorflow/tensorflow,Intel-tensorflow/tensorflow,dendisuhubdy/tensorflow,brchiu/tensorflow,snnn/tensorflow,alshedivat/tensorflow,dendisuhubdy/tensorflow,meteorcloudy/tensorflow,chemelnucfin/tensorflow,ageron/tensorflow,jhseu/tensorflow,aam-at/tensorflow,Bismarrck/tensorflow,jalexvig/tensorflow,asimshankar/tensorflow,jart/tensorflow,yongtang/tensorflow,chemelnucfin/tensorflow,hfp/tensorflow-xsmm,davidzchen/tensorflow,davidzchen/tensorflow,kevin-coder/tensorflow-fork,AnishShah/tensorflow,theflofly/tensorflow,DavidNorman/tensorflow,kobejean/tensorflow,hfp/tensorflow-xsmm,lukeiwanski/tensorflow,freedomtan/tensorflow,girving/tensorflow,gautam1858/tensorflow,jbedorf/tensorflow,nburn42/tensorflow,dancingdan/tensorflow,kevin-coder/tensorflow-fork,aam-at/tensorflow,renyi533/tensorflow,gautam1858/tensorflow,nburn42/tensorflow,eaplatanios/tensorflow,nburn42/tensorflow,jendap/tensorflow,AnishShah/tensorflow,AnishShah/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gojira/tensorflow,kevin-coder/tensorflow-fork,jbedorf/tensorflow,dendisuhubdy/tensorflow,alshedivat/tensorflow,allenlavoie/tensorflow,Intel-Corporation/tensorflow,karllessard/tensorflow,petewarden/tensorflow,jart/tensorflow,ZhangXinNan/tensorflow,annarev/tensorflow,davidzchen/tensorflow,aam-at/tensorflow,seanli9jan/tensorflow,hfp/tensorflow-xsmm,Intel-Corporation/tensorflow,aam-at/tensorflow,hehongliang/tensorflow,ghchinoy/tensorflow,brchiu/tensorflow,xzturn/tensorflow,alsrgv/tensorflow,yanchen036/tensorflow,kevin-coder/tensorflow-fork,caisq/tensorflow,arborh/tensorflow,allenlavoie/tensorflow,gunan/tensorflow,gautam1858/tensorflow,drpngx/tensorflow,xzturn/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,gautam1858/tensorflow,DavidNorman/tensorflow,caisq/tensorflow,aam-at/tensorflow,arborh/tensorflow,hfp/tensorflow-xsmm,karllessard/tensorflow,arborh/tensorflow,theflofly/tensorflow,lukeiwanski/tensorflow,ppwwyyxx/tensorflow,allenlavoie/tensorflow,xzturn/tensorflow,benoitsteiner/tensorflow-xsmm,allenlavoie/tensorflow,xzturn/tensorflow,gautam1858/tensorflow,yanchen036/tensorflow,sarvex/tensorflow,davidzchen/tensorflow,ghchinoy/tensorflow,snnn/tensorflow,annarev/tensorflow,asimshankar/tensorflow,alshedivat/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,alshedivat/tensorflow,dongjoon-hyun/tensorflow,asimshankar/tensorflow,gojira/tensorflow,sarvex/tensorflow,yanchen036/tensorflow,manipopopo/tensorflow,freedomtan/tensorflow,caisq/tensorflow,jalexvig/tensorflow,dongjoon-hyun/tensorflow,jalexvig/tensorflow,gunan/tensorflow,hehongliang/tensorflow,aldian/tensorflow,Intel-tensorflow/tensorflow,theflofly/tensorflow,yongtang/tensorflow,xodus7/tensorflow,hfp/tensorflow-xsmm,tensorflow/tensorflow-pywrap_saved_model,ppwwyyxx/tensorflow,aselle/tensorflow,ZhangXinNan/tensorflow,jbedorf/tensorflow,adit-chandra/tensorflow,chemelnucfin/tensorflow,jalexvig/tensorflow,chemelnucfin/tensorflow,davidzchen/tensorflow,brchiu/tensorflow,sarvex/tensorflow,cxxgtxy/tensorflow,kevin-coder/tensorflow-fork,asimshankar/tensorflow,gunan/tensorflow,DavidNorman/tensorflow,freedomtan/tensorflow,asimshankar/tensorflow,jart/tensorflow,aldian/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_saved_model,xodus7/tensorflow,ppwwyyxx/tensorflow,DavidNorman/tensorflow,jbedorf/tensorflow,girving/tensorflow,arborh/tensorflow,girving/tensorflow,petewarden/tensorflow,ghchinoy/tensorflow,drpngx/tensorflow,arborh/tensorflow,allenlavoie/tensorflow,davidzchen/tensorflow,caisq/tensorflow,Intel-tensorflow/tensorflow,AnishShah/tensorflow,Intel-Corporation/tensorflow,jbedorf/tensorflow,asimshankar/tensorflow,jalexvig/tensorflow,kobejean/tensorflow,Bismarrck/tensorflow,xzturn/tensorflow,aselle/tensorflow,gunan/tensorflow,alsrgv/tensorflow,gojira/tensorflow,AnishShah/tensorflow,xzturn/tensorflow,eaplatanios/tensorflow,freedomtan/tensorflow,ageron/tensorflow,benoitsteiner/tensorflow-xsmm,adit-chandra/tensorflow,xzturn/tensorflow,chemelnucfin/tensorflow,benoitsteiner/tensorflow-xsmm,karllessard/tensorflow,xzturn/tensorflow,xodus7/tensorflow,asimshankar/tensorflow,gunan/tensorflow,ageron/tensorflow,aselle/tensorflow,petewarden/tensorflow,gautam1858/tensorflow,karllessard/tensorflow,jalexvig/tensorflow,yongtang/tensorflow,cxxgtxy/tensorflow,lukeiwanski/tensorflow,ZhangXinNan/tensorflow,jalexvig/tensorflow,paolodedios/tensorflow,ZhangXinNan/tensorflow,jalexvig/tensorflow,ppwwyyxx/tensorflow,renyi533/tensorflow,alsrgv/tensorflow,girving/tensorflow,ageron/tensorflow,gojira/tensorflow,apark263/tensorflow,meteorcloudy/tensorflow,DavidNorman/tensorflow,lukeiwanski/tensorflow,jhseu/tensorflow,dancingdan/tensorflow,lukeiwanski/tensorflow,gunan/tensorflow,girving/tensorflow,theflofly/tensorflow,ghchinoy/tensorflow,davidzchen/tensorflow,eaplatanios/tensorflow,aselle/tensorflow,DavidNorman/tensorflow,renyi533/tensorflow,snnn/tensorflow,tensorflow/tensorflow-pywrap_saved_model,brchiu/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,AnishShah/tensorflow,freedomtan/tensorflow,Intel-tensorflow/tensorflow,freedomtan/tensorflow,caisq/tensorflow,dancingdan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,ageron/tensorflow,petewarden/tensorflow,xzturn/tensorflow,girving/tensorflow,alsrgv/tensorflow,AnishShah/tensorflow,ppwwyyxx/tensorflow,ZhangXinNan/tensorflow,eaplatanios/tensorflow,snnn/tensorflow,tensorflow/tensorflow,allenlavoie/tensorflow,jendap/tensorflow,aam-at/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,petewarden/tensorflow,paolodedios/tensorflow,paolodedios/tensorflow,renyi533/tensorflow,annarev/tensorflow,yongtang/tensorflow,ageron/tensorflow,arborh/tensorflow,tensorflow/tensorflow,meteorcloudy/tensorflow,davidzchen/tensorflow,Bismarrck/tensorflow,yanchen036/tensorflow,aldian/tensorflow,gojira/tensorflow,xzturn/tensorflow,chemelnucfin/tensorflow,theflofly/tensorflow,cxxgtxy/tensorflow,ghchinoy/tensorflow,tensorflow/tensorflow,alshedivat/tensorflow,girving/tensorflow,caisq/tensorflow,tensorflow/tensorflow-pywrap_saved_model,seanli9jan/tensorflow,aselle/tensorflow,jhseu/tensorflow,hfp/tensorflow-xsmm,kobejean/tensorflow,manipopopo/tensorflow,apark263/tensorflow,DavidNorman/tensorflow,dongjoon-hyun/tensorflow,ppwwyyxx/tensorflow,Intel-Corporation/tensorflow,girving/tensorflow,Intel-Corporation/tensorflow,Bismarrck/tensorflow,ageron/tensorflow,manipopopo/tensorflow,Intel-tensorflow/tensorflow,alshedivat/tensorflow,cxxgtxy/tensorflow,hfp/tensorflow-xsmm,frreiss/tensorflow-fred,Intel-Corporation/tensorflow,Bismarrck/tensorflow,hfp/tensorflow-xsmm,renyi533/tensorflow,ghchinoy/tensorflow,davidzchen/tensorflow,alsrgv/tensorflow,apark263/tensorflow,karllessard/tensorflow,chemelnucfin/tensorflow,annarev/tensorflow,lukeiwanski/tensorflow,eaplatanios/tensorflow,asimshankar/tensorflow,dancingdan/tensorflow,apark263/tensorflow,dendisuhubdy/tensorflow,gojira/tensorflow,yanchen036/tensorflow,caisq/tensorflow,asimshankar/tensorflow,dancingdan/tensorflow,adit-chandra/tensorflow,dancingdan/tensorflow,xodus7/tensorflow,kobejean/tensorflow,manipopopo/tensorflow,benoitsteiner/tensorflow-xsmm,dongjoon-hyun/tensorflow,yongtang/tensorflow,jart/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,seanli9jan/tensorflow,Intel-tensorflow/tensorflow