Big Flops, Bigger Bills: GPT-4's $43M Training Cost
·32 words·1 min
A dashboard on AI trends such as flops growth, compute cost growth etc.
Interestingly, GPT-4 compute is estimated by 3 different approaches to 2e25 flop and training cost at $43M.