fixing a fundamental bug which forces recurrent models to use only ONE context frame at prediction time.
fixing a fundamental bug which forces recurrent models to use only ONE context frame at prediction time.

PiperOrigin-RevId: 220007728

tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor