use super to set .game and .player_ids on policyaggregator's policy
use super to set .game and .player_ids on policyaggregator's policy

deepmind/open_spiel,deepmind/open_spiel,deepmind/open_spiel,deepmind/open_spiel,deepmind/open_spiel,deepmind/open_spiel