Batch Sizes on a Diet: Memory-Smart Adjustments
This library measures memory usage in forward pass and then lazily adjusts the batch size. https://x.com/jeanmarcalkazzi/status/1465418318068781062
This library measures memory usage in forward pass and then lazily adjusts the batch size. https://x.com/jeanmarcalkazzi/status/1465418318068781062