Remove tf.summary.record_if(False) guards in tests.
Remove tf.summary.record_if(False) guards in tests.

PiperOrigin-RevId: 249716682
Change-Id: I6185594be005f48cbaee694c64833632ace90446

tensorflow/agents,tensorflow/agents