Optimizers Optimized: No Hyperparameters Required

This is exciting! They spent massive compute to train optimizers that shouldn’t need hyper parameters tuning! https://x.com/jaschasd/status/1593466553642627079

Discussion