ema_count trainable should be False; this was causing the weird dp behavior
ema_count trainable should be False; this was causing the weird dp behavior

PiperOrigin-RevId: 188385238

tensorflow/tensor2tensor,tensorflow/tensor2tensor,tensorflow/tensor2tensor,vthorsteinsson/tensor2tensor,vthorsteinsson/tensor2tensor,vthorsteinsson/tensor2tensor,tensorflow/tensor2tensor,vthorsteinsson/tensor2tensor,tensorflow/tensor2tensor