Plot AIRL episode reward vs epochs
Plot AIRL episode reward vs epochs

We see that generator isn't really improving relative to random.
(reference: expert reward = 49500)

I think I'd consider generator as making progress if the reward
increases beyond 2000 or 3000.

Example output:
-----------------------
Epoch 7000
random reward: 1097.0
generator reward: 1092.0
AIRL train: 100%|███████████████████████████████████████████████████|
250/250 [04:21<00:00,  1.04s/it]
Epoch 7250
random reward: 1053.0
generator reward: 1208.0
AIRL train: 100%|███████████████████████████████████████████████████|
250/250 [04:17<00:00,  1.05s/it]
Epoch 7500
random reward: 1143.0
generator reward: 1071.0

HumanCompatibleAI/imitation,humancompatibleai/imitation,HumanCompatibleAI/imitation,humancompatibleai/imitation