Make it possible to run PPO both in distributed and non-distributed mode.
Make it possible to run PPO both in distributed and non-distributed mode.

PiperOrigin-RevId: 448964763
Change-Id: I032b777f313088161c76b77d057818eba1d73dd0

deepmind/acme,deepmind/acme