Make swish an inlinable function
Make swish an inlinable function

- The implementation of swish currently uses a Defun that specifies
  noinline=True for the purpose of forcing recomputation of the
  sigmoid(x) tensor, instead of incurring the memory overhead of
  keeping it alive from the forward pass.
  This detail (unique within the codebase) is undesirable because
  non-inlined functions are difficult to deal with inside graph
  optimization passes. E.g., the layout optimizer in grappler is
  currently unable to optimize through a non-inlined function call.
- This commit changes the implementation of swish to achieve the same
  force-recomputation effect using a control dependency instead of
  setting noinline=True, allowing the function to be inlined and fully
  optimized by the backend.

aam-at/tensorflow,jhseu/tensorflow,aldian/tensorflow,chemelnucfin/tensorflow,gautam1858/tensorflow,arborh/tensorflow,xzturn/tensorflow,arborh/tensorflow,yongtang/tensorflow,petewarden/tensorflow,DavidNorman/tensorflow,Intel-tensorflow/tensorflow,renyi533/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,renyi533/tensorflow,Intel-tensorflow/tensorflow,gunan/tensorflow,annarev/tensorflow,petewarden/tensorflow,yongtang/tensorflow,xzturn/tensorflow,Intel-tensorflow/tensorflow,cxxgtxy/tensorflow,DavidNorman/tensorflow,chemelnucfin/tensorflow,tensorflow/tensorflow,Intel-Corporation/tensorflow,yongtang/tensorflow,karllessard/tensorflow,ppwwyyxx/tensorflow,arborh/tensorflow,tensorflow/tensorflow,jhseu/tensorflow,tensorflow/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,jhseu/tensorflow,karllessard/tensorflow,karllessard/tensorflow,annarev/tensorflow,petewarden/tensorflow,sarvex/tensorflow,karllessard/tensorflow,ppwwyyxx/tensorflow,petewarden/tensorflow,gautam1858/tensorflow,Intel-tensorflow/tensorflow,tensorflow/tensorflow-pywrap_saved_model,petewarden/tensorflow,adit-chandra/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,gunan/tensorflow,tensorflow/tensorflow,freedomtan/tensorflow,arborh/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,annarev/tensorflow,tensorflow/tensorflow-pywrap_saved_model,annarev/tensorflow,Intel-tensorflow/tensorflow,davidzchen/tensorflow,renyi533/tensorflow,annarev/tensorflow,ppwwyyxx/tensorflow,jhseu/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,gunan/tensorflow,paolodedios/tensorflow,ppwwyyxx/tensorflow,arborh/tensorflow,tensorflow/tensorflow,frreiss/tensorflow-fred,frreiss/tensorflow-fred,freedomtan/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,aam-at/tensorflow,arborh/tensorflow,tensorflow/tensorflow-pywrap_saved_model,yongtang/tensorflow,yongtang/tensorflow,xzturn/tensorflow,paolodedios/tensorflow,freedomtan/tensorflow,freedomtan/tensorflow,jhseu/tensorflow,ppwwyyxx/tensorflow,renyi533/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,freedomtan/tensorflow,freedomtan/tensorflow,renyi533/tensorflow,DavidNorman/tensorflow,karllessard/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,petewarden/tensorflow,xzturn/tensorflow,davidzchen/tensorflow,arborh/tensorflow,chemelnucfin/tensorflow,gunan/tensorflow,arborh/tensorflow,cxxgtxy/tensorflow,adit-chandra/tensorflow,jhseu/tensorflow,annarev/tensorflow,annarev/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,cxxgtxy/tensorflow,davidzchen/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_saved_model,petewarden/tensorflow,petewarden/tensorflow,frreiss/tensorflow-fred,gunan/tensorflow,xzturn/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,chemelnucfin/tensorflow,frreiss/tensorflow-fred,freedomtan/tensorflow,DavidNorman/tensorflow,chemelnucfin/tensorflow,DavidNorman/tensorflow,xzturn/tensorflow,gunan/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,jhseu/tensorflow,arborh/tensorflow,renyi533/tensorflow,cxxgtxy/tensorflow,annarev/tensorflow,karllessard/tensorflow,renyi533/tensorflow,adit-chandra/tensorflow,arborh/tensorflow,karllessard/tensorflow,gunan/tensorflow,ppwwyyxx/tensorflow,sarvex/tensorflow,yongtang/tensorflow,gautam1858/tensorflow,sarvex/tensorflow,renyi533/tensorflow,gautam1858/tensorflow,gunan/tensorflow,renyi533/tensorflow,paolodedios/tensorflow,davidzchen/tensorflow,sarvex/tensorflow,aldian/tensorflow,gautam1858/tensorflow,jhseu/tensorflow,xzturn/tensorflow,yongtang/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,sarvex/tensorflow,DavidNorman/tensorflow,chemelnucfin/tensorflow,xzturn/tensorflow,aam-at/tensorflow,Intel-Corporation/tensorflow,davidzchen/tensorflow,aam-at/tensorflow,petewarden/tensorflow,gunan/tensorflow,arborh/tensorflow,gautam1858/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,arborh/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-pywrap_saved_model,Intel-Corporation/tensorflow,chemelnucfin/tensorflow,aldian/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,davidzchen/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aam-at/tensorflow,chemelnucfin/tensorflow,DavidNorman/tensorflow,tensorflow/tensorflow-pywrap_saved_model,gunan/tensorflow,sarvex/tensorflow,adit-chandra/tensorflow,adit-chandra/tensorflow,aam-at/tensorflow,gautam1858/tensorflow,petewarden/tensorflow,sarvex/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,tensorflow/tensorflow-pywrap_saved_model,xzturn/tensorflow,frreiss/tensorflow-fred,tensorflow/tensorflow-experimental_link_static_libraries_once,Intel-tensorflow/tensorflow,Intel-Corporation/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,adit-chandra/tensorflow,gunan/tensorflow,aam-at/tensorflow,tensorflow/tensorflow,chemelnucfin/tensorflow,frreiss/tensorflow-fred,yongtang/tensorflow,Intel-tensorflow/tensorflow,DavidNorman/tensorflow,DavidNorman/tensorflow,gautam1858/tensorflow,paolodedios/tensorflow,adit-chandra/tensorflow,annarev/tensorflow,petewarden/tensorflow,aam-at/tensorflow,freedomtan/tensorflow,xzturn/tensorflow,aam-at/tensorflow,paolodedios/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,aldian/tensorflow,Intel-Corporation/tensorflow,yongtang/tensorflow,chemelnucfin/tensorflow,cxxgtxy/tensorflow,tensorflow/tensorflow,gunan/tensorflow,aam-at/tensorflow,annarev/tensorflow,frreiss/tensorflow-fred,adit-chandra/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,renyi533/tensorflow,Intel-Corporation/tensorflow,DavidNorman/tensorflow,yongtang/tensorflow,xzturn/tensorflow,yongtang/tensorflow,adit-chandra/tensorflow,annarev/tensorflow,frreiss/tensorflow-fred,cxxgtxy/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,Intel-tensorflow/tensorflow,freedomtan/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,paolodedios/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,paolodedios/tensorflow,aldian/tensorflow,aldian/tensorflow,aam-at/tensorflow,ppwwyyxx/tensorflow,adit-chandra/tensorflow,tensorflow/tensorflow,Intel-tensorflow/tensorflow,renyi533/tensorflow,Intel-Corporation/tensorflow,petewarden/tensorflow,Intel-tensorflow/tensorflow,ppwwyyxx/tensorflow,gautam1858/tensorflow,frreiss/tensorflow-fred,Intel-Corporation/tensorflow,DavidNorman/tensorflow,freedomtan/tensorflow,tensorflow/tensorflow,jhseu/tensorflow,karllessard/tensorflow,tensorflow/tensorflow,gautam1858/tensorflow,chemelnucfin/tensorflow,karllessard/tensorflow,jhseu/tensorflow,tensorflow/tensorflow-pywrap_tf_optimizer,davidzchen/tensorflow,davidzchen/tensorflow,tensorflow/tensorflow-pywrap_saved_model,tensorflow/tensorflow-pywrap_saved_model,paolodedios/tensorflow,ppwwyyxx/tensorflow,tensorflow/tensorflow-experimental_link_static_libraries_once,jhseu/tensorflow,Intel-tensorflow/tensorflow,chemelnucfin/tensorflow,ppwwyyxx/tensorflow,aldian/tensorflow,paolodedios/tensorflow,xzturn/tensorflow,aldian/tensorflow,adit-chandra/tensorflow,adit-chandra/tensorflow,davidzchen/tensorflow,davidzchen/tensorflow,cxxgtxy/tensorflow,renyi533/tensorflow,karllessard/tensorflow,tensorflow/tensorflow-pywrap_saved_model,cxxgtxy/tensorflow