Fix non-square fully observed environments
Fix non-square fully observed environments

PiperOrigin-RevId: 361734971

google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research,google-research/google-research