tweaking hyperparams: lowering batch size because I think 100 is a little too large. Model works better on default data with lower batch size. Also adding learning rate decay hyperparameters because I find this works better in practice. However, they have to be tuned in a reasonable manner and depending on size of dataset etc. For instance, right now learning rate decays after 10 epochs, but for large dataset one rarely ever does that many
tweaking hyperparams: lowering batch size because I think 100 is a little too large. Model works better on default data with lower batch size. Also adding learning rate decay hyperparameters because I find this works better in practice. However, they have to be tuned in a reasonable manner and depending on size of dataset etc. For instance, right now learning rate decays after 10 epochs, but for large dataset one rarely ever does that many

glewis17/monet