When 4,000 GPUs Feel Like an Abacus
Aug 2022: 4,000 A100 is all you need.
Jan 2023: 100,000 A100 is all you need.*
*Based on recent estimates of new compute cluster sizing for StabilityAI and OpenAI.
Aug 2022: 4,000 A100 is all you need.
Jan 2023: 100,000 A100 is all you need.*
*Based on recent estimates of new compute cluster sizing for StabilityAI and OpenAI.