The WSD Learning Rate Schedule
Elections are (hopefully) over and we all can use some cooling down. But you know what else can use some cooldown? Your LR schedule!
I wrote note about this last year and now things are becoming very real. Some people are calling it “WSD schedule” while others are calling it… https://x.com/sytelus/status/1688119658266890240
