Fix normalize advantages PPO when done during train. Small tweak on compute_advantages.
Fix normalize advantages PPO when done during train.
Small tweak on compute_advantages.

PiperOrigin-RevId: 368516256
Change-Id: Ie247d934dc79ac83f9824176ccef64ba1f829b90

tensorflow/agents,tensorflow/agents