Your Random Neural Network Has a 1 in 50,000 Chance of Being the Best
Question: If you designed an architecture with ops selected randomly from {3x3conv, 1x1conv, 3x3maxpool} in resnet like structure, what is the chance that it would turn out to be the best performing arch among all possible archs?
Answer: 1 in 50000
(courtesy NAS Bench 101)