Improvement to Adafactor - add anomaly resisatnce (like gradient
Improvement to Adafactor - add anomaly resisatnce (like gradient

PiperOrigin-RevId: 183740516

rsepassi/tensor2tensor,rsepassi/tensor2tensor,tensorflow/tensor2tensor,vthorsteinsson/tensor2tensor,tensorflow/tensor2tensor,vthorsteinsson/tensor2tensor,rsepassi/tensor2tensor,tensorflow/tensor2tensor,vthorsteinsson/tensor2tensor,vthorsteinsson/tensor2tensor,tensorflow/tensor2tensor,rsepassi/tensor2tensor,tensorflow/tensor2tensor