Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
piercus 
posted an update Jan 13
Post
355
The Loss is a field with holes 🕳️⛳️

🛞 Batch Size is your wheel size.
🏎️ Learning Rate is your speed.

Batch size is the number of holes, or the number of cars. Learning rate is your wheel size (assuming you have enough torque to make it so having a bigger wheel doesn't decrease your wheel RPM).

·

But higher LR makes the path more volatile/unstable ? @nroggendorff

Free AI Image Generator No sign-up. Instant results. Open Now