Neural Networks: Six Edits of Separation
·42 words·1 min
One interesting observation in NAS Bench 101 paper is that the network performance is highly correlated by edit distance between architectures. At edit distance=6, however, correlation is indistinguishable from noise. I call this six degrees of separation for neural networks :).