Improved logging for preference comparison (#516)
Improved logging for preference comparison (#516)

* added logging of ground truth reward log probability when the gt reward is avalible

* Removed logging of distributions since it does not seem to be working.

* fixed bug

* Metrics are now detached and sent to cpu.
HumanCompatibleAI/imitation,HumanCompatibleAI/imitation