Take mean, rather than sum, of the q-learning loss over batch in DQN baseline.
Take mean, rather than sum, of the q-learning loss over batch in DQN baseline.

While this probably makes little to no difference to the optimization, it does allow easier comparison of losses for different agents by making the loss invariant to the batch size.

Resolves https://github.com/deepmind/bsuite/issues/23.

PiperOrigin-RevId: 309683380
Change-Id: Id5fbefbd10af4e9ee58ab8add887fd8e8c50c033

deepmind/bsuite,deepmind/bsuite