Clean up layers_with_gpipe_test and fix the flaky test by lowering AssertClose() tolerance.
Clean up layers_with_gpipe_test and fix the flaky test by lowering AssertClose() tolerance.

PiperOrigin-RevId: 241559439

tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo,tensorflow/lingvo