Fix multi-replica training by setting device before preparing sigmoid parameters.
Fix multi-replica training by setting device before preparing sigmoid parameters.

PiperOrigin-RevId: 390845749

google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research