Neural Networks: Six Edits of Separation
One interesting observation in NAS Bench 101 paper is that the network performance is highly correlated by edit distance between architectures. At edit distance=6, however, correlation is indistinguishable from noise. I call this six degrees of separation for neural networks :).