GPT-4 in 2 Weeks? Just Add 100k GPUs
·18 words·1 min
A rather naive calculation suggests that GPT-4 pretraining should take ~2 weeks if you had 100k GPUs.
A rather naive calculation suggests that GPT-4 pretraining should take ~2 weeks if you had 100k GPUs.