Use use_fused_layernorm param in the self_attention_layer.
Use use_fused_layernorm param in the self_attention_layer.

PiperOrigin-RevId: 338295044

tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo