Matches params of TransformerShardedMoeLayer and TransformerFeedForwardLayer to make them interchangeable in model configs.
Matches params of TransformerShardedMoeLayer and TransformerFeedForwardLayer to make them interchangeable in model configs.

PiperOrigin-RevId: 375572223

tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo