Precompute/hardcode some constants for batch major transformer's per dim scaling to avoid certain fusion op surprices.
Precompute/hardcode some constants for batch major transformer's per dim
scaling to avoid certain fusion op surprices.

PiperOrigin-RevId: 336014247

tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo