Avoid building init op during eval / decoding. This would save some computation time during eval / decode time since init_batch_size is usually very large.
Avoid building init op during eval / decoding. This would save some computation time during eval / decode time since init_batch_size is usually very large.

PiperOrigin-RevId: 220380543

tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor