Progress Disguised: The Float32 log_softmax Bug

Ok, so this whole progress we had been witnessing could turn out to be a feature that was a bug due to float32 precision error in log_softmax. https://x.com/AggieInCA/status/1542255687362744322

Discussion