Add quantization mode to Distributed Shampoo. This follows the quantization logic used in Lingvo JAX for momentum buffers, future CLs will try to improve this with cover sets used in SM3.
Add quantization mode to Distributed Shampoo.
This follows the quantization logic used in Lingvo JAX for momentum buffers, future CLs will try to improve this with cover sets used in SM3.

PiperOrigin-RevId: 420891140

google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research