Skip to main content

When Learning Rates Go Rogue in Deep Models

·26 words·1 min · Download pdf

If you have wondered about why learning rates so unexpectedly behaves for training deep models, this is an invaluable post with lot to digest. https://x.com/prfsanjeevarora/status/1319309006163353600

Discussion