Remove use of placeholders in common_test for TF2.0 compatibility.
Remove use of placeholders in common_test for TF2.0 compatibility.

PiperOrigin-RevId: 232351875
Change-Id: I2dbecb1a47bd5a00b680883ebefb9567fcc1ce3c

tensorflow/agents,tensorflow/agents