Add an option "min_dim_size_to_factor" to AdafactorOptimizer specifying how large the dimensions of a tensor must be for its accumulator to be factored. Set the default value to 32 (previously hardcoded to 128). This may break continued training from existing checkpoints.  For backward training compatibility, pass min_dim_size_to_factor=128 to AdafactorOptimizer.
Add an option "min_dim_size_to_factor" to AdafactorOptimizer specifying how large the dimensions of a tensor must be for its accumulator to be factored.
Set the default value to 32 (previously hardcoded to 128).
This may break continued training from existing checkpoints.  For backward training compatibility, pass min_dim_size_to_factor=128 to AdafactorOptimizer.

PiperOrigin-RevId: 231228538

tensorflow/mesh,tensorflow/mesh