Threshold the scaling value to the smallest representable positive value in quantized layer normalization to prevent scaling by 0 when the number of features is large and precision is low.
Threshold the scaling value to the smallest representable positive value in quantized layer normalization to prevent scaling by 0 when the number of features is large and precision is low.

PiperOrigin-RevId: 374947046

google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research